Jul 07 22:24:31 devstack cinder-volume[76454]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 07 22:24:31 devstack cinder-volume[76454]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 22:24:31 devstack cinder-volume[76454]: we strongly recommend against using it for new projects.
Jul 07 22:24:31 devstack cinder-volume[76454]: If you are already using Eventlet, we recommend migrating to a different
Jul 07 22:24:31 devstack cinder-volume[76454]: framework.  For more detail see
Jul 07 22:24:31 devstack cinder-volume[76454]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 22:24:31 devstack cinder-volume[76454]:   import eventlet  # noqa
Jul 07 22:24:34 devstack cinder-volume[76454]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76454) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:24:34 devstack cinder-volume[76454]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76454) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:24:34 devstack cinder-volume[76454]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76454) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:24:35 devstack cinder-volume[76454]: INFO dbcounter [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Registered counter for database cinder
Jul 07 22:24:35 devstack cinder-volume[76454]: DEBUG oslo_db.sqlalchemy.engines [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76454) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:24:35 devstack cinder-volume[76454]: DEBUG dbcounter [-] [76454] Writer thread running {{(pid=76454) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:24:35 devstack cinder-volume[76454]: INFO cinder.rpc [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 07 22:24:35 devstack cinder-volume[76454]: INFO cinder.rpc [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 07 22:24:35 devstack cinder-volume[76454]: DEBUG oslo_db.sqlalchemy.engines [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76454) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:24:35 devstack cinder-volume[76454]: INFO cinder.volume.manager [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Determined volume DB was empty at startup.
Jul 07 22:24:35 devstack cinder-volume[76454]: DEBUG cinder.volume.manager [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76454) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 07 22:24:35 devstack cinder-volume[76454]: INFO cinder.volume.manager [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 07 22:24:35 devstack cinder-volume[76454]: WARNING stevedore.named [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 22:24:35 devstack cinder-volume[76454]: WARNING castellan.key_manager [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:24:35 devstack cinder-volume[76454]: WARNING cinder.keymgr.conf_key_mgr [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:24:35 devstack cinder-volume[76454]: DEBUG cinder.volume.drivers.lvm [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76454) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 07 22:24:35 devstack cinder-volume[76454]: DEBUG oslo_concurrency.processutils [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76454) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_concurrency.processutils [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] CMD "cinder-rtstool verify" returned: 0 in 0.619s {{(pid=76454) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_db.sqlalchemy.engines [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76454) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:24:36 devstack cinder-volume[76454]: INFO cinder.rpc [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 07 22:24:36 devstack cinder-volume[76454]: INFO cinder.rpc [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 07 22:24:36 devstack cinder-volume[76454]: WARNING stevedore.named [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 22:24:36 devstack cinder-volume[76454]: WARNING castellan.key_manager [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:24:36 devstack cinder-volume[76454]: INFO cinder.volume.manager [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_db.sqlalchemy.engines [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76454) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:24:36 devstack cinder-volume[76454]: INFO oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Starting 1 workers
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Started child 76624 {{(pid=76454) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Full set of CONF: {{(pid=76454) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] ******************************************************************************** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Configuration options gathered from: {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] ================================================================================ {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] allow_availability_zone_fallback = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] allow_compression_on_image_upload = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] allowed_direct_url_schemes     = [] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] api_rate_limit                 = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] auth_strategy                  = keystone {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] az_cache_duration              = 3600 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_availability_zone      = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76624]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_host                   = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_name                   = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_stats_polling_interval = 60 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backup_api_class               = cinder.backup.api.API {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backup_name_template           = backup-%s {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backup_use_same_host           = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backup_use_temp_snapshot       = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] chap_password                  = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] chap_username                  =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cinder_internal_tenant_project_id = 4936a66f80744035a442c2166d9730b6 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cinder_internal_tenant_user_id = 7227184e87094e9e9ec01b0ce32fe751 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cloned_volume_same_az          = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cluster                        = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] compression_format             = gzip {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] compute_api_class              = cinder.compute.nova.API {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] config_dir                     = [] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] config_source                  = [] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] control_exchange               = openstack {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] debug                          = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] default_availability_zone      = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] default_group_type             = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] default_volume_type            = lvmdriver-1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] disk_geometry                  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] driver_client_cert             = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] driver_client_cert_key         = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] driver_data_namespace          = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] driver_ssl_cert_path           = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] driver_ssl_cert_verify         = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] driver_use_ssl                 = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] enable_force_upload            = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] enable_new_services            = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] enable_unsupported_driver      = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] enforce_multipath_for_image_xfer = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] filter_function                = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance_api_insecure            = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance_api_servers             = ['http://192.168.122.23/image'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance_api_ssl_compression     = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance_ca_certificates_file    = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance_catalog_info            = image:glance:publicURL {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance_certfile                = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance_keyfile                 = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance_num_retries             = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance_request_timeout         = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] goodness_function              = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] graceful_shutdown_timeout      = 5 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] group_api_class                = cinder.group.api.API {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] host                           = devstack {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] image_compress_on_upload       = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] image_conversion_address_space_limit = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] image_conversion_cpu_limit     = 60 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] image_conversion_disable       = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] image_upload_use_cinder_backend = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] image_upload_use_internal_tenant = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] image_volume_cache_enabled     = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] image_volume_cache_max_count   = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] image_volume_cache_max_size_gb = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] init_host_max_objects_retrieval = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] instance_format                = [instance: %(uuid)s]  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] iscsi_target_flags             =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] iscsi_write_cache              = on {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] iser_helper                    = tgtadm {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] iser_ip_address                = 192.168.122.23 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] iser_port                      = 3260 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] log_color                      = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] log_config_append              = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] log_dir                        = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] log_file                       = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] log_options                    = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] log_rotate_interval            = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] log_rotate_interval_type       = days {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] log_rotation_type              = none {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] max_age                        = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] max_logfile_count              = 30 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] max_logfile_size_mb            = 200 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] max_over_subscription_ratio    = 20.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] message_reap_interval          = 86400 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] message_ttl                    = 2592000 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] migration_create_volume_timeout_secs = 300 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] monkey_patch                   = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] monkey_patch_modules           = [] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] my_ip                          = 192.168.122.23 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] no_snapshot_gb_quota           = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] num_iser_scan_tries            = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] num_shell_tries                = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] num_volume_device_scan_tries   = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] nvmeof_conn_info_version       = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] nvmet_ns_id                    = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] nvmet_port_id                  = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] osapi_max_limit                = 1000 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] osapi_volume_ext_list          = [] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] osapi_volume_listen_port       = 8776 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] osapi_volume_use_ssl           = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] osapi_volume_workers           = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] per_volume_size_limit          = -1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] periodic_fuzzy_delay           = 60 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] periodic_interval              = 60 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] public_endpoint                = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] publish_errors                 = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] quota_backup_gigabytes         = 1000 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] quota_backups                  = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] quota_gigabytes                = 1000 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] quota_groups                   = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] quota_snapshots                = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] quota_volumes                  = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] rate_limit_burst               = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] rate_limit_except_level        = CRITICAL {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] rate_limit_interval            = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] reinit_driver_count            = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] replication_device             = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76624]: INFO cinder.volume.manager [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] report_discard_supported       = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] report_interval                = 120 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] reservation_clean_interval     = 86400 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] reservation_expire             = 86400 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] reserved_image_namespaces      = [] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] reserved_percentage            = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] rpc_response_timeout           = 120 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] run_external_periodic_tasks    = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] scst_target_driver             = iscsi {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] scst_target_iqn_name           = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_down_time              = 720 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] shell_completion               = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] snapshot_name_template         = snapshot-%s {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] snapshot_same_host             = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] split_loggers                  = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] state_path                     = /opt/stack/data/cinder {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] storage_availability_zone      = nova {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] storage_protocol               = iSCSI {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] syslog_log_facility            = LOG_USER {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] target_helper                  = lioadm {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] target_ip_address              = 192.168.122.23 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] target_port                    = 3260 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] target_protocol                = iscsi {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] target_secondary_ip_addresses  = [] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] trace_flags                    = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] transport_url                  = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] until_refresh                  = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] use_chap_auth                  = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] use_default_quota_class        = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] use_journal                    = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] use_json                       = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] use_multipath_for_image_xfer   = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] use_stderr                     = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] use_syslog                     = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] verify_glance_signatures       = enabled {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_api_class               = cinder.volume.api.API {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_backend_name            = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_clear                   = zero {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_clear_ionice            = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_clear_size              = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_copy_bps_limit          = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_dd_blocksize            = 1M {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_name_template           = volume-%s {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_service_inithost_offload = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volume_usage_audit_period      = month {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] zoning_mode                    = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_concurrency.disable_process_locking = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.auth_section = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.auth_type   = password {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.auth_version = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.cache       = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.certfile    = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.include_service_catalog = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.insecure    = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.interface   = public {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.keyfile     = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_password =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcache_username =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.region_name = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.service_token_roles_required = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.service_type = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.backend                  = dogpile.cache.null {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.backend_argument         = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.backend_expiration_time  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.config_prefix            = cache.oslo {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.debug_cache_backend      = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.enable_retry_client      = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.enable_socket_keepalive  = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.enabled                  = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.expiration_time          = 600 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.hashclient_retry_attempts = 2 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.memcache_dead_retry      = 300 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.memcache_pool_maxsize    = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.memcache_sasl_enabled    = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.password                 = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.proxies                  = [] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.redis_db                 = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.redis_server             = localhost:6379 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.retry_attempts           = 2 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.retry_delay              = 0.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.socket_keepalive_count   = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.socket_keepalive_idle    = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.socket_keepalive_interval = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.socket_timeout           = 1.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.tls_allowed_ciphers      = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.tls_cafile               = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.tls_certfile             = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.tls_enabled              = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.tls_keyfile              = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cache.username                 = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] coordination.backend_url       = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.asyncio_connection    = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.asyncio_slave_connection = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.backend               = sqlalchemy {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.connection            = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.connection_debug      = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.connection_parameters =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.connection_recycle_time = 3600 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.connection_trace      = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.db_inc_retry_interval = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.db_max_retries        = 20 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.db_max_retry_interval = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.db_retry_interval     = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.max_overflow          = 50 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.max_pool_size         = 5 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.max_retries           = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.mysql_wsrep_sync_wait = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.pool_timeout          = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.retry_interval        = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.slave_connection      = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.sqlite_synchronous    = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.synchronous_reader    = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] database.use_db_reconnect      = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.connection_string     = messaging:// {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.enabled               = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.es_doc_type           = notification {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.es_scroll_size        = 10000 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.es_scroll_time        = 2m {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.filter_error_trace    = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.hmac_keys             = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.sentinel_service_name = mymaster {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.socket_timeout        = 0.1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.trace_requests        = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler.trace_sqlalchemy      = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler_jaeger.process_tags   = {} {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler_jaeger.service_name_prefix = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] profiler_otlp.service_name_prefix = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.enforce_new_defaults = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.enforce_scope      = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.policy_default_rule = default {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.policy_file        = policy.yaml {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] privsep_osbrick.group          = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] privsep_osbrick.helper_command = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] privsep_osbrick.user           = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cinder_sys_admin.group         = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cinder_sys_admin.helper_command = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] cinder_sys_admin.user          = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_user.auth_section      = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_user.auth_type         = password {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_user.cafile            = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_user.certfile          = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_user.collect_timing    = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_user.insecure          = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_user.keyfile           = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_user.send_service_user_token = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_user.split_loggers     = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] service_user.timeout           = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance.auth_section            = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance.auth_type               = password {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance.certfile                = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance.collect_timing          = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance.insecure                = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance.keyfile                 = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance.region_name             = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance.split_loggers           = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] glance.timeout                 = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.backend_availability_zone = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.chap_password = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.chap_username =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.disk_geometry = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.driver_client_cert = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.driver_client_cert_key = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.driver_data_namespace = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.driver_use_ssl = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.extra_capabilities = {} {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.filter_function = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.goodness_function = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.iscsi_target_flags =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.iscsi_write_cache = on {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.iser_helper   = tgtadm {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.iser_port     = 3260 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.lvm_share_target = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.lvm_type      = auto {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack sudo[76629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.num_shell_tries = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack sudo[76629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.replication_device = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.report_discard_supported = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.reserved_percentage = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.target_helper = tgtadm {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.target_port   = 3260 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.target_protocol = iscsi {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.trace_flags   = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.unique_fqdn_network = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.use_chap_auth = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.volume_backend_name = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.volume_clear  = zero {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.volume_clear_ionice = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.volume_clear_size = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_reports.file_event_handler = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_reports.log_dir           = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.backend_host       = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.chap_password      = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.chap_username      = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.disk_geometry      = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.driver_client_cert = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.extra_capabilities = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.filter_function    = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.goodness_function  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.iser_helper        = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.iser_ip_address    = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.iser_port          = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.lvm_share_target   = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.lvm_type           = auto {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.num_shell_tries    = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.replication_device = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.report_discard_supported = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.reserved_percentage = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.scst_target_driver = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.storage_protocol   = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.target_helper      = lioadm {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.target_ip_address  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.target_port        = 3260 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.trace_flags        = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.use_chap_auth      = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.volume_clear       = zero {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.volume_clear_size  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] lvmdriver-1.volumes_dir        = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.ssl      = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_notifications.driver = [] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_notifications.retry = -1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] key_manager.fixed_key          = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.barbican_api_version  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.barbican_endpoint     = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.barbican_endpoint_type = public {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.barbican_region_name  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.cafile                = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.certfile              = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.collect_timing        = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.insecure              = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.keyfile               = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.number_of_retries     = 60 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.retry_delay           = 1 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.send_service_user_token = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.split_loggers         = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.timeout               = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.verify_ssl            = True {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican.verify_ssl_path       = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican_service_user.auth_section = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican_service_user.auth_type = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican_service_user.cafile   = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican_service_user.certfile = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican_service_user.collect_timing = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican_service_user.insecure = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican_service_user.keyfile  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican_service_user.split_loggers = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] barbican_service_user.timeout  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.approle_role_id          = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.approle_secret_id        = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.kv_mountpoint            = secret {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.kv_path                  = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.kv_version               = 2 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.namespace                = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.root_token_id            = **** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.ssl_ca_crt_file          = None {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.timeout                  = 60.0 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.use_ssl                  = False {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:24:36 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] ******************************************************************************** {{(pid=76454) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 07 22:24:37 devstack sudo[76629]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:37 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:37 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:37 devstack sudo[76739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:24:37 devstack sudo[76739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:38 devstack sudo[76739]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:38 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.646s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:38 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:24:38 devstack cinder-volume[76624]: INFO cinder.brick.local_dev.lvm [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 07 22:24:38 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:38 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:38 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:38 devstack sudo[76966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:24:38 devstack sudo[76966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:38 devstack sudo[76966]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:38 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.743s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:38 devstack cinder-volume[76624]: DEBUG cinder.brick.local_dev.lvm [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76624) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 07 22:24:38 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:38 devstack sudo[77192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:24:38 devstack sudo[77192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:39 devstack sudo[77192]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:39 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.134s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:39 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:40 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:40 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:40 devstack sudo[77387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:24:40 devstack sudo[77387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:40 devstack sudo[77387]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:40 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.729s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:40 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:40 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:40 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:40 devstack sudo[77409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 07 22:24:40 devstack sudo[77409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:41 devstack sudo[77409]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:41 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.713s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:41 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:41 devstack sudo[77416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:24:41 devstack sudo[77416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:42 devstack sudo[77416]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:42 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:42 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:42 devstack sudo[77424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:24:42 devstack sudo[77424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:42 devstack sudo[77424]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:42 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.733s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:42 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:42 devstack sudo[77435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:24:42 devstack sudo[77435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:43 devstack sudo[77435]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:43 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.728s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:43 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:43 devstack sudo[77440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:24:43 devstack sudo[77440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:44 devstack sudo[77440]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:44 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.775s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:44 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:44 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:44 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:44 devstack sudo[77446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:24:44 devstack sudo[77446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:45 devstack sudo[77446]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:45 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.690s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:45 devstack cinder-volume[76624]: INFO cinder.volume.drivers.lvm [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 07 22:24:45 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:45 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:45 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:45 devstack sudo[77458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:24:45 devstack sudo[77458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:46 devstack sudo[77458]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:46 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.819s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:46 devstack cinder-volume[76624]: DEBUG cinder.volume.drivers.lvm [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Updating volume stats {{(pid=76624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:24:46 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:46 devstack sudo[77573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:24:46 devstack sudo[77573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:46 devstack cinder-volume[76454]: DEBUG dbcounter [-] [76454] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76454) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:24:46 devstack sudo[77573]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:46 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:46 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:46 devstack sudo[77580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:24:46 devstack sudo[77580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:47 devstack sudo[77580]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:47 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:47 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:47 devstack sudo[77584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:24:47 devstack sudo[77584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:47 devstack sudo[77584]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:47 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:47 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:47 devstack sudo[77587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:24:47 devstack sudo[77587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:48 devstack sudo[77587]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:48 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:48 devstack cinder-volume[76624]: INFO cinder.volume.driver [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Driver hasn't implemented _init_vendor_properties()
Jul 07 22:24:48 devstack cinder-volume[76624]: DEBUG cinder.volume.driver [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76624) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 07 22:24:48 devstack cinder-volume[76624]: DEBUG oslo_db.sqlalchemy.engines [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76624) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:24:48 devstack cinder-volume[76624]: DEBUG dbcounter [-] [76624] Writer thread running {{(pid=76624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:24:48 devstack cinder-volume[76624]: DEBUG cinder.db.api [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Building query based on filter {{(pid=76624) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 07 22:24:48 devstack cinder-volume[76624]: DEBUG cinder.image.image_utils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76624) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 07 22:24:48 devstack cinder-volume[76624]: INFO cinder.keymgr.migration [None req-5c70f4a5-d95c-4eac-95e2-a3c953f830ae None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 07 22:24:48 devstack cinder-volume[76624]: DEBUG cinder.volume.drivers.lvm [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Updating volume stats {{(pid=76624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:24:48 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:48 devstack sudo[77592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:24:48 devstack sudo[77592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:49 devstack sudo[77592]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:49 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:49 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:49 devstack sudo[77596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:24:49 devstack sudo[77596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:50 devstack sudo[77596]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:50 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.661s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:50 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:50 devstack sudo[77603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:24:50 devstack sudo[77603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:50 devstack sudo[77603]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:50 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.610s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:50 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:50 devstack sudo[77606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:24:50 devstack sudo[77606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:51 devstack sudo[77606]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:51 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:51 devstack cinder-volume[76624]: DEBUG cinder.manager [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Notifying Schedulers of capabilities ... {{(pid=76624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:24:51 devstack cinder-volume[76624]: INFO cinder.volume.manager [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Driver initialization completed successfully.
Jul 07 22:24:51 devstack cinder-volume[76624]: INFO cinder.manager [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Initiating service 2 cleanup
Jul 07 22:24:51 devstack cinder-volume[76624]: INFO cinder.manager [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Service 2 cleanup completed.
Jul 07 22:24:51 devstack cinder-volume[76624]: DEBUG cinder.service [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Creating RPC server for service cinder-volume {{(pid=76624) start /opt/stack/cinder/cinder/service.py:231}}
Jul 07 22:24:51 devstack cinder-volume[76624]: DEBUG cinder.service [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76624) start /opt/stack/cinder/cinder/service.py:237}}
Jul 07 22:24:51 devstack cinder-volume[76624]: INFO cinder.volume.manager [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 07 22:24:51 devstack cinder-volume[76624]: DEBUG cinder.volume.drivers.lvm [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Updating volume stats {{(pid=76624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:24:51 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:51 devstack sudo[77609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:24:51 devstack sudo[77609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:52 devstack sudo[77609]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:52 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:52 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:52 devstack sudo[77612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:24:52 devstack sudo[77612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:52 devstack sudo[77612]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:52 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:52 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:52 devstack sudo[77615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:24:52 devstack sudo[77615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:53 devstack sudo[77615]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:53 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:53 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:24:53 devstack sudo[77621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:24:53 devstack sudo[77621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:24:54 devstack sudo[77621]: pam_unix(sudo:session): session closed for user root
Jul 07 22:24:54 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:24:54 devstack cinder-volume[76624]: INFO cinder.volume.manager [None req-3ed78e96-46c7-488f-9776-a27b113efef5 None None] Driver post RPC initialization completed successfully.
Jul 07 22:25:04 devstack cinder-volume[76624]: DEBUG dbcounter [-] [76624] Writing DB stats cinder:SELECT=3 {{(pid=76624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:25:04 devstack cinder-volume[76624]: DEBUG dbcounter [-] [76624] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:25:18 devstack cinder-volume[76624]: DEBUG oslo_service.periodic_task [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running periodic task VolumeManager._thread_info {{(pid=76624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:25:18 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] thread count: 6 {{(pid=76624) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:25:18 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] thread info: [<_MainThread(MainThread, started 134208226472064)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134208119487936)>, <Thread(Thread-3 (stat_writer), started daemon 134208116277632)>, <Thread(Rabbit-heartbeat, started daemon 134208114657280)>, <Thread(Thread-5 (_runner), started daemon 134208114100288)>, <Thread(Thread-7 (_runner), started daemon 134208114200640)>] {{(pid=76624) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:26:18 devstack cinder-volume[76624]: DEBUG oslo_service.periodic_task [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:26:18 devstack cinder-volume[76624]: DEBUG cinder.volume.drivers.lvm [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Updating volume stats {{(pid=76624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:26:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:18 devstack sudo[78894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:26:18 devstack sudo[78894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:18 devstack sudo[78894]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:18 devstack sudo[78897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:26:18 devstack sudo[78897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:19 devstack sudo[78897]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:19 devstack sudo[78900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:26:19 devstack sudo[78900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:19 devstack sudo[78900]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:19 devstack sudo[78964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:26:19 devstack sudo[78964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:20 devstack sudo[78964]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:20 devstack cinder-volume[76624]: DEBUG cinder.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Notifying Schedulers of capabilities ... {{(pid=76624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:26:20 devstack cinder-volume[76624]: DEBUG oslo_service.periodic_task [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running periodic task VolumeManager._thread_info {{(pid=76624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:26:20 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] thread count: 6 {{(pid=76624) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:26:20 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] thread info: [<_MainThread(MainThread, started 134208226472064)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134208119487936)>, <Thread(Thread-3 (stat_writer), started daemon 134208116277632)>, <Thread(Rabbit-heartbeat, started daemon 134208114657280)>, <Thread(Thread-5 (_runner), started daemon 134208114100288)>, <Thread(Thread-7 (_runner), started daemon 134208114200640)>] {{(pid=76624) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:27:04 devstack cinder-volume[76624]: DEBUG dbcounter [-] [76624] Writing DB stats cinder:SELECT=1 {{(pid=76624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:27:04 devstack cinder-volume[76624]: DEBUG dbcounter [-] [76624] Writing DB stats cinder:UPDATE=1 {{(pid=76624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:27:18 devstack cinder-volume[76624]: DEBUG oslo_service.periodic_task [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:27:18 devstack cinder-volume[76624]: DEBUG cinder.volume.drivers.lvm [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Updating volume stats {{(pid=76624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:27:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:27:18 devstack sudo[80623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:27:18 devstack sudo[80623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:27:18 devstack sudo[80623]: pam_unix(sudo:session): session closed for user root
Jul 07 22:27:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:27:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:27:18 devstack sudo[80626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:27:18 devstack sudo[80626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:27:19 devstack sudo[80626]: pam_unix(sudo:session): session closed for user root
Jul 07 22:27:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.689s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:27:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:27:19 devstack sudo[80630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:27:19 devstack sudo[80630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:27:20 devstack sudo[80630]: pam_unix(sudo:session): session closed for user root
Jul 07 22:27:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:27:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:27:20 devstack sudo[80660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:27:20 devstack sudo[80660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:27:20 devstack sudo[80660]: pam_unix(sudo:session): session closed for user root
Jul 07 22:27:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.738s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:27:20 devstack cinder-volume[76624]: DEBUG cinder.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Notifying Schedulers of capabilities ... {{(pid=76624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:27:20 devstack cinder-volume[76624]: DEBUG oslo_service.periodic_task [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running periodic task VolumeManager._thread_info {{(pid=76624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:27:20 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] thread count: 6 {{(pid=76624) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:27:20 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] thread info: [<_MainThread(MainThread, started 134208226472064)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134208119487936)>, <Thread(Thread-3 (stat_writer), started daemon 134208116277632)>, <Thread(Rabbit-heartbeat, started daemon 134208114657280)>, <Thread(Thread-5 (_runner), started daemon 134208114100288)>, <Thread(Thread-7 (_runner), started daemon 134208114200640)>] {{(pid=76624) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:28:18 devstack cinder-volume[76624]: DEBUG oslo_service.periodic_task [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:28:18 devstack cinder-volume[76624]: DEBUG cinder.volume.drivers.lvm [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Updating volume stats {{(pid=76624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:28:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:28:18 devstack sudo[83610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:28:18 devstack sudo[83610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:28:18 devstack sudo[83610]: pam_unix(sudo:session): session closed for user root
Jul 07 22:28:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:28:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:28:18 devstack sudo[83621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:28:18 devstack sudo[83621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:28:19 devstack sudo[83621]: pam_unix(sudo:session): session closed for user root
Jul 07 22:28:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:28:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:28:19 devstack sudo[83630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:28:19 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:28:20 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root
Jul 07 22:28:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.708s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:28:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:28:20 devstack sudo[83647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:28:20 devstack sudo[83647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:28:20 devstack sudo[83647]: pam_unix(sudo:session): session closed for user root
Jul 07 22:28:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:28:20 devstack cinder-volume[76624]: DEBUG cinder.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Notifying Schedulers of capabilities ... {{(pid=76624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:29:04 devstack cinder-volume[76624]: DEBUG dbcounter [-] [76624] Writing DB stats cinder:SELECT=1 {{(pid=76624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:29:04 devstack cinder-volume[76624]: DEBUG dbcounter [-] [76624] Writing DB stats cinder:UPDATE=1 {{(pid=76624) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:29:18 devstack cinder-volume[76624]: DEBUG oslo_service.periodic_task [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:29:18 devstack cinder-volume[76624]: DEBUG cinder.volume.drivers.lvm [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Updating volume stats {{(pid=76624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:29:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:29:18 devstack sudo[85546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:29:18 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:29:18 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root
Jul 07 22:29:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:29:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:29:18 devstack sudo[85549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:29:18 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:29:19 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root
Jul 07 22:29:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:29:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:29:19 devstack sudo[85558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:29:19 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:29:20 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root
Jul 07 22:29:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.724s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:29:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:29:20 devstack sudo[85601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:29:20 devstack sudo[85601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:29:20 devstack sudo[85601]: pam_unix(sudo:session): session closed for user root
Jul 07 22:29:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.741s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:29:20 devstack cinder-volume[76624]: DEBUG cinder.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Notifying Schedulers of capabilities ... {{(pid=76624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:29:20 devstack cinder-volume[76624]: DEBUG oslo_service.periodic_task [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running periodic task VolumeManager._thread_info {{(pid=76624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:29:20 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] thread count: 6 {{(pid=76624) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:29:20 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] thread info: [<_MainThread(MainThread, started 134208226472064)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134208119487936)>, <Thread(Thread-3 (stat_writer), started daemon 134208116277632)>, <Thread(Rabbit-heartbeat, started daemon 134208114657280)>, <Thread(Thread-5 (_runner), started daemon 134208114100288)>, <Thread(Thread-7 (_runner), started daemon 134208114200640)>] {{(pid=76624) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:30:18 devstack cinder-volume[76624]: DEBUG oslo_service.periodic_task [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:30:18 devstack cinder-volume[76624]: DEBUG cinder.volume.drivers.lvm [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Updating volume stats {{(pid=76624) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:30:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:18 devstack sudo[86860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:30:18 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:18 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.705s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:18 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:18 devstack sudo[86866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:30:18 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:19 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:19 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:19 devstack sudo[86871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:30:19 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:20 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:20 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:30:20 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:20 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:20 devstack cinder-volume[76624]: DEBUG oslo_concurrency.processutils [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=76624) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:20 devstack cinder-volume[76624]: DEBUG cinder.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Notifying Schedulers of capabilities ... {{(pid=76624) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:30:20 devstack cinder-volume[76624]: DEBUG oslo_service.periodic_task [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] Running periodic task VolumeManager._thread_info {{(pid=76624) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:30:20 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] thread count: 6 {{(pid=76624) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:30:20 devstack cinder-volume[76624]: DEBUG cinder.volume.manager [None req-96dd8df3-fd76-4145-8149-9e9671e32d5e None None] thread info: [<_MainThread(MainThread, started 134208226472064)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134208119487936)>, <Thread(Thread-3 (stat_writer), started daemon 134208116277632)>, <Thread(Rabbit-heartbeat, started daemon 134208114657280)>, <Thread(Thread-5 (_runner), started daemon 134208114100288)>, <Thread(Thread-7 (_runner), started daemon 134208114200640)>] {{(pid=76624) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:30:31 devstack cinder-volume[76454]: INFO oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Caught SIGTERM, stopping children
Jul 07 22:30:31 devstack cinder-volume[76454]: DEBUG oslo_concurrency.lockutils [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Acquiring lock "singleton_lock" {{(pid=76454) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:30:31 devstack cinder-volume[76454]: DEBUG oslo_concurrency.lockutils [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Acquired lock "singleton_lock" {{(pid=76454) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:30:31 devstack cinder-volume[76454]: DEBUG oslo_concurrency.lockutils [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Releasing lock "singleton_lock" {{(pid=76454) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:30:31 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Stop services. {{(pid=76454) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 07 22:30:31 devstack cinder-volume[76454]: DEBUG oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Killing children. {{(pid=76454) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 07 22:30:31 devstack cinder-volume[76454]: INFO oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Waiting on 1 children to exit
Jul 07 22:30:36 devstack cinder-volume[76624]: DEBUG oslo_concurrency.lockutils [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Acquiring lock "singleton_lock" {{(pid=76624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:30:36 devstack cinder-volume[76624]: DEBUG oslo_concurrency.lockutils [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Acquired lock "singleton_lock" {{(pid=76624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:30:36 devstack cinder-volume[76624]: DEBUG oslo_concurrency.lockutils [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Releasing lock "singleton_lock" {{(pid=76624) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:30:36 devstack cinder-volume[76624]: WARNING amqp [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 22:30:36 devstack cinder-volume[76624]: WARNING amqp [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 22:30:36 devstack cinder-volume[76454]: INFO oslo_service.backend._eventlet.service [None req-8813dc7c-6b98-474e-a0d4-b09ed43ec03b None None] Child 76624 exited with status 0
Jul 07 22:30:36 devstack cinder-volume[87268]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 07 22:30:36 devstack cinder-volume[87268]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 22:30:36 devstack cinder-volume[87268]: we strongly recommend against using it for new projects.
Jul 07 22:30:36 devstack cinder-volume[87268]: If you are already using Eventlet, we recommend migrating to a different
Jul 07 22:30:36 devstack cinder-volume[87268]: framework.  For more detail see
Jul 07 22:30:36 devstack cinder-volume[87268]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 22:30:36 devstack cinder-volume[87268]:   import eventlet  # noqa
Jul 07 22:30:39 devstack cinder-volume[87268]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:30:39 devstack cinder-volume[87268]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:30:39 devstack cinder-volume[87268]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:30:39 devstack cinder-volume[87268]: INFO dbcounter [None req-096f2969-feae-4347-9085-565b2500c879 None None] Registered counter for database cinder
Jul 07 22:30:39 devstack cinder-volume[87268]: DEBUG oslo_db.sqlalchemy.engines [None req-096f2969-feae-4347-9085-565b2500c879 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG dbcounter [-] [87268] Writer thread running {{(pid=87268) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:30:40 devstack cinder-volume[87268]: INFO cinder.rpc [None req-096f2969-feae-4347-9085-565b2500c879 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 07 22:30:40 devstack cinder-volume[87268]: INFO cinder.rpc [None req-096f2969-feae-4347-9085-565b2500c879 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_db.sqlalchemy.engines [None req-096f2969-feae-4347-9085-565b2500c879 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:30:40 devstack cinder-volume[87268]: INFO cinder.volume.manager [None req-096f2969-feae-4347-9085-565b2500c879 None None] Determined volume DB was empty at startup.
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG cinder.volume.manager [None req-096f2969-feae-4347-9085-565b2500c879 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87268) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 07 22:30:40 devstack cinder-volume[87268]: INFO cinder.volume.manager [None req-096f2969-feae-4347-9085-565b2500c879 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 07 22:30:40 devstack cinder-volume[87268]: WARNING stevedore.named [None req-096f2969-feae-4347-9085-565b2500c879 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 22:30:40 devstack cinder-volume[87268]: WARNING castellan.key_manager [None req-096f2969-feae-4347-9085-565b2500c879 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:30:40 devstack cinder-volume[87268]: WARNING cinder.keymgr.conf_key_mgr [None req-096f2969-feae-4347-9085-565b2500c879 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:30:40 devstack cinder-volume[87268]: INFO cinder.volume.manager [None req-096f2969-feae-4347-9085-565b2500c879 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_db.sqlalchemy.engines [None req-096f2969-feae-4347-9085-565b2500c879 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87268) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:30:40 devstack cinder-volume[87268]: INFO oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] Starting 1 workers
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] Started child 87482 {{(pid=87268) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] Full set of CONF: {{(pid=87268) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] ******************************************************************************** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] Configuration options gathered from: {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] ================================================================================ {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] allow_availability_zone_fallback = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87482]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] allow_compression_on_image_upload = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] allowed_direct_url_schemes     = [] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] api_rate_limit                 = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] auth_strategy                  = keystone {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_availability_zone      = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_host                   = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_name                   = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_stats_polling_interval = 60 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backup_api_class               = cinder.backup.api.API {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backup_name_template           = backup-%s {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backup_use_same_host           = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backup_use_temp_snapshot       = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] chap_password                  = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] chap_username                  =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cinder_internal_tenant_project_id = 4936a66f80744035a442c2166d9730b6 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cinder_internal_tenant_user_id = 7227184e87094e9e9ec01b0ce32fe751 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cluster                        = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] compression_format             = gzip {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] config_dir                     = [] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] config_source                  = [] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] control_exchange               = openstack {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] debug                          = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] default_availability_zone      = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] default_group_type             = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] default_volume_type            = QuobyteHD {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] disk_geometry                  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] driver_client_cert             = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] driver_client_cert_key         = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] driver_data_namespace          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] driver_ssl_cert_path           = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] driver_ssl_cert_verify         = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] driver_use_ssl                 = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] enable_new_services            = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] enable_unsupported_driver      = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] enforce_multipath_for_image_xfer = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] filter_function                = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance_api_insecure            = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance_api_servers             = ['http://192.168.122.23/image'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance_api_ssl_compression     = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance_ca_certificates_file    = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance_certfile                = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance_keyfile                 = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance_num_retries             = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance_request_timeout         = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] goodness_function              = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] graceful_shutdown_timeout      = 5 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] group_api_class                = cinder.group.api.API {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] host                           = devstack {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] image_compress_on_upload       = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] image_conversion_address_space_limit = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] image_conversion_cpu_limit     = 60 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] image_conversion_disable       = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] image_upload_use_cinder_backend = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] image_upload_use_internal_tenant = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] image_volume_cache_enabled     = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] image_volume_cache_max_count   = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] image_volume_cache_max_size_gb = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] init_host_max_objects_retrieval = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] iscsi_target_flags             =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] iscsi_write_cache              = on {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] iser_helper                    = tgtadm {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] iser_ip_address                = 192.168.122.23 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] iser_port                      = 3260 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87482]: INFO cinder.volume.manager [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 07 22:30:40 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.remotefs [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87482) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] log_color                      = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] log_config_append              = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] log_dir                        = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] log_file                       = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] log_options                    = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] log_rotate_interval            = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] log_rotate_interval_type       = days {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] log_rotation_type              = none {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] max_age                        = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] max_logfile_count              = 30 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] max_logfile_size_mb            = 200 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] max_over_subscription_ratio    = 20.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] message_reap_interval          = 86400 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] message_ttl                    = 2592000 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] migration_create_volume_timeout_secs = 300 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] monkey_patch                   = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] monkey_patch_modules           = [] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] my_ip                          = 192.168.122.23 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] no_snapshot_gb_quota           = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] num_iser_scan_tries            = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] num_shell_tries                = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] num_volume_device_scan_tries   = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] nvmeof_conn_info_version       = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] nvmet_ns_id                    = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] nvmet_port_id                  = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] osapi_max_limit                = 1000 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] osapi_volume_ext_list          = [] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] osapi_volume_listen_port       = 8776 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] osapi_volume_use_ssl           = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] osapi_volume_workers           = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] per_volume_size_limit          = -1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] periodic_fuzzy_delay           = 60 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] periodic_interval              = 60 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] public_endpoint                = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] publish_errors                 = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] quota_backup_gigabytes         = 1000 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] quota_backups                  = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] quota_gigabytes                = 1000 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] quota_groups                   = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] quota_snapshots                = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] quota_volumes                  = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] rate_limit_burst               = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] rate_limit_except_level        = CRITICAL {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] rate_limit_interval            = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] reinit_driver_count            = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] replication_device             = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] report_discard_supported       = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] report_interval                = 120 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] reservation_clean_interval     = 86400 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] reservation_expire             = 86400 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] reserved_image_namespaces      = [] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] reserved_percentage            = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] rpc_response_timeout           = 120 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] run_external_periodic_tasks    = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] scst_target_driver             = iscsi {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] scst_target_iqn_name           = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_down_time              = 720 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] shell_completion               = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] snapshot_name_template         = snapshot-%s {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] split_loggers                  = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] state_path                     = /opt/stack/data/cinder {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] storage_availability_zone      = nova {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] storage_protocol               = iSCSI {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] syslog_log_facility            = LOG_USER {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] target_helper                  = lioadm {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] target_ip_address              = 192.168.122.23 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] target_port                    = 3260 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] target_protocol                = iscsi {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] target_secondary_ip_addresses  = [] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] trace_flags                    = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] transport_url                  = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] until_refresh                  = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] use_chap_auth                  = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] use_default_quota_class        = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] use_journal                    = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] use_json                       = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] use_multipath_for_image_xfer   = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] use_stderr                     = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] use_syslog                     = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] verify_glance_signatures       = enabled {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_api_class               = cinder.volume.api.API {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_backend_name            = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_clear                   = zero {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_clear_ionice            = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_clear_size              = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_copy_bps_limit          = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_dd_blocksize            = 1M {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_name_template           = volume-%s {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_service_inithost_offload = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volume_usage_audit_period      = month {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] zoning_mode                    = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_concurrency.disable_process_locking = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.auth_section = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.auth_type   = password {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.auth_version = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.cache       = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.certfile    = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.include_service_catalog = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.insecure    = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.interface   = public {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.keyfile     = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_password =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcache_username =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.region_name = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.service_type = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.backend                  = dogpile.cache.null {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.backend_argument         = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.backend_expiration_time  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.config_prefix            = cache.oslo {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.debug_cache_backend      = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.enable_retry_client      = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.enable_socket_keepalive  = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.enabled                  = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.expiration_time          = 600 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.hashclient_retry_attempts = 2 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.memcache_dead_retry      = 300 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87482) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 07 22:30:40 devstack cinder-volume[87482]: WARNING cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 07 22:30:40 devstack cinder-volume[87482]: WARNING cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 07 22:30:40 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Running cmd (subprocess): mount.quobyte {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.memcache_sasl_enabled    = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.password                 = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.proxies                  = [] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.redis_db                 = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.redis_server             = localhost:6379 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.retry_attempts           = 2 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.retry_delay              = 0.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.socket_keepalive_count   = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.socket_keepalive_idle    = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.socket_keepalive_interval = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.socket_timeout           = 1.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.tls_allowed_ciphers      = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.tls_cafile               = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.tls_certfile             = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.tls_enabled              = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.tls_keyfile              = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cache.username                 = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] coordination.backend_url       = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.asyncio_connection    = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.asyncio_slave_connection = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.backend               = sqlalchemy {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.connection            = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.connection_debug      = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.connection_parameters =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.connection_recycle_time = 3600 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.connection_trace      = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.db_inc_retry_interval = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.db_max_retries        = 20 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.db_max_retry_interval = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.db_retry_interval     = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.max_overflow          = 50 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.max_pool_size         = 5 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.max_retries           = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.mysql_wsrep_sync_wait = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.pool_timeout          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.retry_interval        = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.slave_connection      = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.sqlite_synchronous    = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.synchronous_reader    = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] database.use_db_reconnect      = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.connection_string     = messaging:// {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.enabled               = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.es_doc_type           = notification {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.es_scroll_size        = 10000 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.es_scroll_time        = 2m {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.filter_error_trace    = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.hmac_keys             = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.sentinel_service_name = mymaster {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.socket_timeout        = 0.1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.trace_requests        = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler.trace_sqlalchemy      = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler_jaeger.process_tags   = {} {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler_jaeger.service_name_prefix = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] profiler_otlp.service_name_prefix = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.enforce_new_defaults = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.enforce_scope      = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.policy_default_rule = default {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] privsep_osbrick.group          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] privsep_osbrick.helper_command = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] privsep_osbrick.user           = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cinder_sys_admin.group         = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cinder_sys_admin.helper_command = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] cinder_sys_admin.user          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_user.auth_section      = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_user.auth_type         = password {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_user.cafile            = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_user.certfile          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_user.collect_timing    = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_user.insecure          = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_user.keyfile           = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_user.send_service_user_token = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_user.split_loggers     = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] service_user.timeout           = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance.auth_section            = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance.auth_type               = password {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance.certfile                = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance.collect_timing          = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance.insecure                = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance.keyfile                 = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance.region_name             = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance.split_loggers           = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] glance.timeout                 = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.backend_availability_zone = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.chap_password = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.chap_username =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.disk_geometry = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.driver_client_cert = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.driver_client_cert_key = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.driver_data_namespace = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.driver_use_ssl = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.extra_capabilities = {} {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.filter_function = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.goodness_function = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.iscsi_target_flags =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.iscsi_write_cache = on {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.iser_port     = 3260 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nas_host      =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nas_login     = admin {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nas_mount_options = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nas_password  = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nas_private_key =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nas_share_path =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.num_shell_tries = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.quobyte_volume_url = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.replication_device = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.report_discard_supported = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.reserved_percentage = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.target_helper = tgtadm {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.target_port   = 3260 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.target_protocol = iscsi {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.trace_flags   = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.unique_fqdn_network = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.use_chap_auth = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.volume_backend_name = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.volume_clear  = zero {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.volume_clear_ionice = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.volume_clear_size = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_reports.file_event_handler = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_reports.log_dir           = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.backend_availability_zone = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.backend_host         = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.chap_password        = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.chap_username        = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.disk_geometry        = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.driver_client_cert   = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.driver_data_namespace = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.extra_capabilities   = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.filter_function      = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.goodness_function    = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.iser_helper          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.iser_ip_address      = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.iser_port            = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nas_host             = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nas_login            = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nas_mount_options    = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nas_password         = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nas_private_key      = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nas_share_path       = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.num_shell_tries      = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.replication_device   = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.report_discard_supported = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.reserved_percentage  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.scst_target_driver   = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.storage_protocol     = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.target_helper        = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.target_ip_address    = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.target_port          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.target_prefix        = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.target_protocol      = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.trace_flags          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.use_chap_auth        = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.volume_clear         = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.volume_clear_size    = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] QuobyteHD.volumes_dir          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack quobyte-client[87483]: Reading configuration file: /etc/quobyte/client.cfg
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack quobyte-client[87483]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_notifications.driver = [] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_notifications.retry = -1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] key_manager.fixed_key          = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.barbican_api_version  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.barbican_endpoint     = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.barbican_endpoint_type = public {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.barbican_region_name  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.cafile                = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.certfile              = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.collect_timing        = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.insecure              = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.keyfile               = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.number_of_retries     = 60 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.retry_delay           = 1 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.send_service_user_token = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.split_loggers         = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.timeout               = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.verify_ssl            = True {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican.verify_ssl_path       = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican_service_user.auth_section = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican_service_user.auth_type = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican_service_user.cafile   = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican_service_user.certfile = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican_service_user.collect_timing = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican_service_user.insecure = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican_service_user.keyfile  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican_service_user.split_loggers = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] CMD "mount.quobyte" returned: 1 in 0.157s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:40 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:30:40 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:30:40 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=87482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] barbican_service_user.timeout  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.approle_role_id          = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.approle_secret_id        = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.kv_mountpoint            = secret {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.kv_path                  = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.kv_version               = 2 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.namespace                = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87482]: INFO cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 ...
Jul 07 22:30:40 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f -c /etc/quobyte/client-cinder.cfg {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.root_token_id            = **** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.ssl_ca_crt_file          = None {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.timeout                  = 60.0 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.use_ssl                  = False {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:30:40 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] ******************************************************************************** {{(pid=87268) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 07 22:30:40 devstack sudo[87486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f -c /etc/quobyte/client-cinder.cfg
Jul 07 22:30:40 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:41 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:41 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.829s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:41 devstack cinder-volume[87482]: INFO cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 succeeded
Jul 07 22:30:41 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=87482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:30:41 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.845s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:30:41 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:41 devstack sudo[87557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:30:41 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:42 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.656s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:42 devstack cinder-volume[87482]: INFO cinder.volume.driver [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Driver hasn't implemented _init_vendor_properties()
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG cinder.volume.driver [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7463302612305, 'free_capacity_gb': 1775.7463302612305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87482) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG oslo_db.sqlalchemy.engines [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87482) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG dbcounter [-] [87482] Writer thread running {{(pid=87482) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG cinder.db.api [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Building query based on filter {{(pid=87482) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG cinder.image.image_utils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87482) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 07 22:30:42 devstack cinder-volume[87482]: INFO cinder.keymgr.migration [None req-b12c799f-837c-44f7-9a92-a5dd400901e4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=87482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=87482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:30:42 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:42 devstack sudo[87566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:30:42 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:43 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:43 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.701s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:43 devstack cinder-volume[87482]: DEBUG cinder.manager [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Notifying Schedulers of capabilities ... {{(pid=87482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:30:43 devstack cinder-volume[87482]: INFO cinder.volume.manager [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Driver initialization completed successfully.
Jul 07 22:30:43 devstack cinder-volume[87482]: INFO cinder.manager [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Initiating service 3 cleanup
Jul 07 22:30:43 devstack cinder-volume[87482]: INFO cinder.manager [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Service 3 cleanup completed.
Jul 07 22:30:43 devstack cinder-volume[87482]: DEBUG cinder.service [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Creating RPC server for service cinder-volume {{(pid=87482) start /opt/stack/cinder/cinder/service.py:231}}
Jul 07 22:30:43 devstack cinder-volume[87482]: DEBUG cinder.service [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87482) start /opt/stack/cinder/cinder/service.py:237}}
Jul 07 22:30:43 devstack cinder-volume[87482]: INFO cinder.volume.manager [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 07 22:30:43 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:30:43 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:30:43 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=87482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:30:43 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=87482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:30:43 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:30:43 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:43 devstack sudo[87573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:30:43 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:44 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:44 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.881s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:44 devstack cinder-volume[87482]: INFO cinder.volume.manager [None req-68e8cb3b-f35c-471a-a733-a3c57f249081 None None] Driver post RPC initialization completed successfully.
Jul 07 22:30:48 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-7fde94c6-ef96-4c74-b71b-9ff55d669365 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:30:48 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-7fde94c6-ef96-4c74-b71b-9ff55d669365 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:30:48 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-7fde94c6-ef96-4c74-b71b-9ff55d669365 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=87482) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:30:48 devstack cinder-volume[87482]: DEBUG cinder.volume.drivers.quobyte [None req-7fde94c6-ef96-4c74-b71b-9ff55d669365 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=87482) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:30:48 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-7fde94c6-ef96-4c74-b71b-9ff55d669365 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87482) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:30:48 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-7fde94c6-ef96-4c74-b71b-9ff55d669365 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:48 devstack sudo[87686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:30:48 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:48 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:48 devstack cinder-volume[87482]: DEBUG oslo_concurrency.processutils [None req-7fde94c6-ef96-4c74-b71b-9ff55d669365 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.600s {{(pid=87482) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:48 devstack cinder-volume[87482]: DEBUG cinder.manager [None req-7fde94c6-ef96-4c74-b71b-9ff55d669365 None None] Notifying Schedulers of capabilities ... {{(pid=87482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:30:50 devstack cinder-volume[87268]: DEBUG dbcounter [-] [87268] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87268) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:30:50 devstack cinder-volume[87268]: INFO oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] Caught SIGTERM, stopping children
Jul 07 22:30:50 devstack cinder-volume[87268]: DEBUG oslo_concurrency.lockutils [None req-096f2969-feae-4347-9085-565b2500c879 None None] Acquiring lock "singleton_lock" {{(pid=87268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:30:50 devstack cinder-volume[87268]: DEBUG oslo_concurrency.lockutils [None req-096f2969-feae-4347-9085-565b2500c879 None None] Acquired lock "singleton_lock" {{(pid=87268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:30:50 devstack cinder-volume[87268]: DEBUG oslo_concurrency.lockutils [None req-096f2969-feae-4347-9085-565b2500c879 None None] Releasing lock "singleton_lock" {{(pid=87268) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:30:50 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] Stop services. {{(pid=87268) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 07 22:30:50 devstack cinder-volume[87268]: DEBUG oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] Killing children. {{(pid=87268) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 07 22:30:50 devstack cinder-volume[87268]: INFO oslo_service.backend._eventlet.service [None req-096f2969-feae-4347-9085-565b2500c879 None None] Waiting on 1 children to exit
Jul 07 22:30:54 devstack cinder-volume[87482]: DEBUG dbcounter [-] [87482] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87482) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:30:54 devstack cinder-volume[87482]: DEBUG dbcounter [-] [87482] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87482) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:30:55 devstack cinder-volume[87482]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 07 22:30:56 devstack cinder-volume[87790]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 07 22:30:56 devstack cinder-volume[87790]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 22:30:56 devstack cinder-volume[87790]: we strongly recommend against using it for new projects.
Jul 07 22:30:56 devstack cinder-volume[87790]: If you are already using Eventlet, we recommend migrating to a different
Jul 07 22:30:56 devstack cinder-volume[87790]: framework.  For more detail see
Jul 07 22:30:56 devstack cinder-volume[87790]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 22:30:56 devstack cinder-volume[87790]:   import eventlet  # noqa
Jul 07 22:30:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-096f2969-feae-4347-9085-565b2500c879 None None] Acquiring lock "singleton_lock" {{(pid=87482) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:30:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-096f2969-feae-4347-9085-565b2500c879 None None] Acquired lock "singleton_lock" {{(pid=87482) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:30:56 devstack cinder-volume[87482]: DEBUG oslo_concurrency.lockutils [None req-096f2969-feae-4347-9085-565b2500c879 None None] Releasing lock "singleton_lock" {{(pid=87482) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:30:56 devstack cinder-volume[87482]: WARNING amqp [None req-096f2969-feae-4347-9085-565b2500c879 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 22:30:56 devstack cinder-volume[87482]: WARNING amqp [None req-096f2969-feae-4347-9085-565b2500c879 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 22:30:58 devstack cinder-volume[87790]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87790) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:30:58 devstack cinder-volume[87790]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87790) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:30:58 devstack cinder-volume[87790]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87790) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:30:59 devstack cinder-volume[87790]: INFO dbcounter [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Registered counter for database cinder
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_db.sqlalchemy.engines [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87790) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG dbcounter [-] [87790] Writer thread running {{(pid=87790) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:30:59 devstack cinder-volume[87790]: INFO cinder.rpc [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 07 22:30:59 devstack cinder-volume[87790]: INFO cinder.rpc [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_db.sqlalchemy.engines [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87790) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:30:59 devstack cinder-volume[87790]: INFO cinder.volume.manager [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Determined volume DB was empty at startup.
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG cinder.volume.manager [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87790) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 07 22:30:59 devstack cinder-volume[87790]: WARNING stevedore.named [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 22:30:59 devstack cinder-volume[87790]: WARNING castellan.key_manager [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:30:59 devstack cinder-volume[87790]: WARNING cinder.keymgr.conf_key_mgr [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:30:59 devstack cinder-volume[87790]: INFO cinder.volume.manager [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_db.sqlalchemy.engines [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87790) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:30:59 devstack cinder-volume[87790]: INFO oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Starting 1 workers
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Started child 88077 {{(pid=87790) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Full set of CONF: {{(pid=87790) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] ******************************************************************************** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] Configuration options gathered from: {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] ================================================================================ {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] allow_availability_zone_fallback = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] allow_compression_on_image_upload = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] allowed_direct_url_schemes     = [] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] api_rate_limit                 = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] auth_strategy                  = keystone {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_availability_zone      = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_host                   = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_name                   = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_stats_polling_interval = 60 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backup_api_class               = cinder.backup.api.API {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backup_name_template           = backup-%s {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backup_use_same_host           = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backup_use_temp_snapshot       = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] chap_password                  = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] chap_username                  =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[88077]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cinder_internal_tenant_project_id = 4936a66f80744035a442c2166d9730b6 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cinder_internal_tenant_user_id = 7227184e87094e9e9ec01b0ce32fe751 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cluster                        = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] compression_format             = gzip {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] compute_api_class              = cinder.compute.nova.API {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] config_dir                     = [] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] config_source                  = [] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] control_exchange               = openstack {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] debug                          = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] default_availability_zone      = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] default_group_type             = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] default_volume_type            = QuobyteHD {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] disk_geometry                  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] driver_client_cert             = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] driver_client_cert_key         = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] driver_data_namespace          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] driver_ssl_cert_path           = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] driver_ssl_cert_verify         = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] driver_use_ssl                 = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] enable_new_services            = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] enable_unsupported_driver      = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] enabled_backends               = ['QuobyteHD'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] enforce_multipath_for_image_xfer = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] filter_function                = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance_api_insecure            = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance_api_servers             = ['http://192.168.122.23/image'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance_api_ssl_compression     = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance_ca_certificates_file    = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance_catalog_info            = image:glance:publicURL {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance_certfile                = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance_keyfile                 = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance_num_retries             = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance_request_timeout         = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] goodness_function              = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] graceful_shutdown_timeout      = 5 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] group_api_class                = cinder.group.api.API {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] host                           = devstack {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] image_compress_on_upload       = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] image_conversion_address_space_limit = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] image_conversion_cpu_limit     = 60 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] image_conversion_disable       = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] image_upload_use_cinder_backend = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] image_upload_use_internal_tenant = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] image_volume_cache_enabled     = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] image_volume_cache_max_count   = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] image_volume_cache_max_size_gb = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] init_host_max_objects_retrieval = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] instance_format                = [instance: %(uuid)s]  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] iscsi_target_flags             =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] iscsi_write_cache              = on {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] iser_helper                    = tgtadm {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] iser_ip_address                = 192.168.122.23 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] iser_port                      = 3260 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] log_color                      = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] log_config_append              = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] log_dir                        = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] log_file                       = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] log_options                    = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] log_rotate_interval            = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] log_rotate_interval_type       = days {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] log_rotation_type              = none {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:30:59 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] max_age                        = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] max_logfile_count              = 30 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] max_logfile_size_mb            = 200 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] max_over_subscription_ratio    = 20.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] message_reap_interval          = 86400 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] message_ttl                    = 2592000 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] migration_create_volume_timeout_secs = 300 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] monkey_patch                   = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] monkey_patch_modules           = [] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] my_ip                          = 192.168.122.23 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] no_snapshot_gb_quota           = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] num_iser_scan_tries            = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] num_shell_tries                = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] num_volume_device_scan_tries   = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] nvmeof_conn_info_version       = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] nvmet_ns_id                    = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] nvmet_port_id                  = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] osapi_max_limit                = 1000 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] osapi_volume_ext_list          = [] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] osapi_volume_listen_port       = 8776 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] osapi_volume_use_ssl           = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] osapi_volume_workers           = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] per_volume_size_limit          = -1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] periodic_fuzzy_delay           = 60 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] periodic_interval              = 60 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] public_endpoint                = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] publish_errors                 = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] quota_backup_gigabytes         = 1000 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] quota_backups                  = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] quota_gigabytes                = 1000 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] quota_groups                   = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] quota_snapshots                = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] quota_volumes                  = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] rate_limit_burst               = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] rate_limit_except_level        = CRITICAL {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] rate_limit_interval            = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] reinit_driver_count            = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88077) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] replication_device             = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] report_discard_supported       = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] report_interval                = 120 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] reservation_clean_interval     = 86400 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] reservation_expire             = 86400 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] reserved_image_namespaces      = [] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] reserved_percentage            = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] rpc_response_timeout           = 120 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] run_external_periodic_tasks    = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] scst_target_driver             = iscsi {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] scst_target_iqn_name           = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_down_time              = 720 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] shell_completion               = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] snapshot_name_template         = snapshot-%s {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] split_loggers                  = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] state_path                     = /opt/stack/data/cinder {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] storage_availability_zone      = nova {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] storage_protocol               = iSCSI {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] syslog_log_facility            = LOG_USER {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] target_helper                  = lioadm {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] target_ip_address              = 192.168.122.23 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] target_port                    = 3260 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] target_protocol                = iscsi {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] target_secondary_ip_addresses  = [] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] trace_flags                    = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] transport_url                  = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] until_refresh                  = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] use_chap_auth                  = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] use_default_quota_class        = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] use_journal                    = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] use_json                       = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] use_multipath_for_image_xfer   = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] use_stderr                     = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] use_syslog                     = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] verify_glance_signatures       = enabled {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_api_class               = cinder.volume.api.API {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_backend_name            = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_clear                   = zero {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_clear_ionice            = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_clear_size              = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_copy_bps_limit          = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_dd_blocksize            = 1M {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_name_template           = volume-%s {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_service_inithost_offload = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volume_usage_audit_period      = month {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] zoning_mode                    = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_concurrency.disable_process_locking = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.auth_section = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.auth_type   = password {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.auth_version = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.cache       = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.certfile    = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.include_service_catalog = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.insecure    = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.interface   = public {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.keyfile     = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_password =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcache_username =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.region_name = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.service_type = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.23/identity {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.backend                  = dogpile.cache.null {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.backend_argument         = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.backend_expiration_time  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.config_prefix            = cache.oslo {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.debug_cache_backend      = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.enable_retry_client      = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.enable_socket_keepalive  = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.enabled                  = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.expiration_time          = 600 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.hashclient_retry_attempts = 2 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.memcache_dead_retry      = 300 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.memcache_pool_maxsize    = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.memcache_sasl_enabled    = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.password                 = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.proxies                  = [] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.redis_db                 = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.redis_server             = localhost:6379 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.retry_attempts           = 2 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.retry_delay              = 0.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.socket_keepalive_count   = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.socket_keepalive_idle    = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.socket_keepalive_interval = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.socket_timeout           = 1.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.tls_allowed_ciphers      = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.tls_cafile               = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.tls_certfile             = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.tls_enabled              = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.tls_keyfile              = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cache.username                 = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] coordination.backend_url       = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.asyncio_connection    = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.asyncio_slave_connection = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.backend               = sqlalchemy {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.connection            = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.connection_debug      = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.connection_parameters =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.connection_recycle_time = 3600 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.connection_trace      = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.db_inc_retry_interval = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.db_max_retries        = 20 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.db_max_retry_interval = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.db_retry_interval     = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.max_overflow          = 50 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.max_pool_size         = 5 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.max_retries           = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.mysql_wsrep_sync_wait = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.pool_timeout          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.retry_interval        = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.slave_connection      = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.sqlite_synchronous    = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.synchronous_reader    = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] database.use_db_reconnect      = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.connection_string     = messaging:// {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.enabled               = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.es_doc_type           = notification {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.es_scroll_size        = 10000 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.es_scroll_time        = 2m {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.filter_error_trace    = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.hmac_keys             = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.sentinel_service_name = mymaster {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.socket_timeout        = 0.1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.trace_requests        = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler.trace_sqlalchemy      = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88077) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler_jaeger.process_tags   = {} {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.quobyte [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler_jaeger.service_name_prefix = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.quobyte [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] profiler_otlp.service_name_prefix = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.enforce_new_defaults = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.enforce_scope      = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.policy_default_rule = default {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Running cmd (subprocess): mount.quobyte {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.policy_file        = policy.yaml {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] privsep_osbrick.group          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] privsep_osbrick.helper_command = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] privsep_osbrick.user           = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cinder_sys_admin.group         = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cinder_sys_admin.helper_command = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] cinder_sys_admin.user          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_user.auth_section      = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_user.auth_type         = password {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_user.cafile            = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_user.certfile          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_user.collect_timing    = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_user.insecure          = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_user.keyfile           = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_user.send_service_user_token = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_user.split_loggers     = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] service_user.timeout           = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance.auth_section            = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance.auth_type               = password {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance.certfile                = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance.collect_timing          = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance.insecure                = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance.keyfile                 = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance.region_name             = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance.split_loggers           = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] glance.timeout                 = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.backend_availability_zone = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.chap_password = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.chap_username =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.disk_geometry = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.driver_client_cert = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.driver_client_cert_key = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.driver_data_namespace = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.driver_use_ssl = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.extra_capabilities = {} {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.filter_function = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.goodness_function = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.iscsi_target_flags =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.iscsi_write_cache = on {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.iser_helper   = tgtadm {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.iser_ip_address = 192.168.122.23 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.iser_port     = 3260 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nas_host      =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nas_login     = admin {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nas_mount_options = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nas_password  = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nas_private_key =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nas_share_path =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.num_shell_tries = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.quobyte_volume_url = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.replication_device = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.report_discard_supported = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.reserved_percentage = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.target_helper = tgtadm {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.target_ip_address = 192.168.122.23 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.target_port   = 3260 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.target_protocol = iscsi {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.trace_flags   = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.unique_fqdn_network = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.use_chap_auth = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.volume_backend_name = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.volume_clear  = zero {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.volume_clear_ionice = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.volume_clear_size = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_reports.file_event_handler = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_reports.log_dir           = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.backend_availability_zone = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.backend_host         = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.chap_password        = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.chap_username        = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.chiscsi_conf         = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.disk_geometry        = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.driver_client_cert   = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.driver_data_namespace = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.driver_use_ssl       = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack quobyte-client[88079]: Reading configuration file: /etc/quobyte/client.cfg
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.extra_capabilities   = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.filter_function      = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.goodness_function    = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack quobyte-client[88079]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.iser_helper          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.iser_ip_address      = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.iser_port            = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.iser_target_prefix   = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nas_host             = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nas_login            = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nas_mount_options    = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nas_password         = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nas_private_key      = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nas_share_path       = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nas_ssh_port         = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.num_shell_tries      = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.nvmet_port_id        = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.replication_device   = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.report_discard_supported = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.reserved_percentage  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.scst_target_driver   = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.storage_protocol     = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.target_helper        = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.target_ip_address    = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.target_port          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.target_prefix        = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.target_protocol      = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.trace_flags          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.use_chap_auth        = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.volume_clear         = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.volume_clear_size    = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] QuobyteHD.volumes_dir          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.ssl      = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_notifications.driver = [] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_notifications.retry = -1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] key_manager.fixed_key          = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.barbican_api_version  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.barbican_endpoint     = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.barbican_endpoint_type = public {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.barbican_region_name  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.cafile                = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.certfile              = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.collect_timing        = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.insecure              = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.keyfile               = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.number_of_retries     = 60 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.retry_delay           = 1 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.send_service_user_token = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.split_loggers         = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.timeout               = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.verify_ssl            = True {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican.verify_ssl_path       = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican_service_user.auth_section = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican_service_user.auth_type = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican_service_user.cafile   = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican_service_user.certfile = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican_service_user.collect_timing = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican_service_user.insecure = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack sudo[88085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican_service_user.keyfile  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican_service_user.split_loggers = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] barbican_service_user.timeout  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.approle_role_id          = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.approle_secret_id        = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.kv_mountpoint            = secret {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.kv_path                  = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.kv_version               = 2 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.namespace                = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.root_token_id            = **** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.ssl_ca_crt_file          = None {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.timeout                  = 60.0 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.use_ssl                  = False {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:31:00 devstack cinder-volume[87790]: DEBUG oslo_service.backend._eventlet.service [None req-b268721d-12ac-4103-a52b-0c15b114c251 None None] ******************************************************************************** {{(pid=87790) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 07 22:31:00 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.638s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:31:00 devstack cinder-volume[88077]: INFO cinder.volume.driver [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Driver hasn't implemented _init_vendor_properties()
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG cinder.volume.driver [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7463302612305, 'free_capacity_gb': 1775.7463302612305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88077) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_db.sqlalchemy.engines [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88077) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writer thread running {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG cinder.db.api [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Building query based on filter {{(pid=88077) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88077) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:31:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:31:00 devstack cinder-volume[88077]: INFO cinder.keymgr.migration [None req-3790f9db-3e03-4cef-a63c-50bafb25bb24 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 07 22:31:00 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:31:00 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:31:01 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Jul 07 22:31:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.683s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:31:01 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:31:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Driver initialization completed successfully.
Jul 07 22:31:01 devstack cinder-volume[88077]: INFO cinder.manager [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Initiating service 3 cleanup
Jul 07 22:31:01 devstack cinder-volume[88077]: INFO cinder.manager [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Service 3 cleanup completed.
Jul 07 22:31:01 devstack cinder-volume[88077]: DEBUG cinder.service [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Creating RPC server for service cinder-volume {{(pid=88077) start /opt/stack/cinder/cinder/service.py:231}}
Jul 07 22:31:01 devstack cinder-volume[88077]: DEBUG cinder.service [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88077) start /opt/stack/cinder/cinder/service.py:237}}
Jul 07 22:31:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 07 22:31:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:31:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:31:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:31:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:31:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:31:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:31:01 devstack sudo[88191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:31:01 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:31:02 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root
Jul 07 22:31:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.645s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:31:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c1495397-bcc8-49d2-8561-7b9dee378f47 None None] Driver post RPC initialization completed successfully.
Jul 07 22:31:09 devstack cinder-volume[87790]: DEBUG dbcounter [-] [87790] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87790) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:31:11 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:31:12 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:31:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:31:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 6 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:31:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Flow 'volume_create_manager' (55d32497-2c39-4693-8612-df34579e3f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78749f5c-4c0d-49b8-9809-268fecda1eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78749f5c-4c0d-49b8-9809-268fecda1eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1632768097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da47e910-5799-4c3b-98f8-60c17ddf96b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a445973280d4c47a98fc3d5c2f6078f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:59Z,use_quota=True,user_id='d478517b17954d1daa0274411ea1c830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a426b1-f0db-4079-8e7c-ed28a7aa3fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a426b1-f0db-4079-8e7c-ed28a7aa3fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07f164a-8700-43c9-9a37-c67a7e23c0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07f164a-8700-43c9-9a37-c67a7e23c0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da47e910-5799-4c3b-98f8-60c17ddf96b2', 'volume_name': 'volume-da47e910-5799-4c3b-98f8-60c17ddf96b2', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe73ccbe-3b83-4b1b-8a19-c45e7c19b9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe73ccbe-3b83-4b1b-8a19-c45e7c19b9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555b227f-f74b-4a99-bf7d-43e40f29479b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:31:59 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Volume da47e910-5799-4c3b-98f8-60c17ddf96b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da47e910-5799-4c3b-98f8-60c17ddf96b2', 'volume_size': 1}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:31:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1632768097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da47e910-5799-4c3b-98f8-60c17ddf96b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a445973280d4c47a98fc3d5c2f6078f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:31:59Z,use_quota=True,user_id='d478517b17954d1daa0274411ea1c830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Creating volume da47e910-5799-4c3b-98f8-60c17ddf96b2 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:31:59 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:31:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:31:59 devstack sudo[88552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2 1073741824
Jul 07 22:31:59 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Flow 'volume_create_manager' (a05fbf56-04ea-4be5-b567-e5ea557e8475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0291ce-9454-4127-8413-937a3f377883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a0291ce-9454-4127-8413-937a3f377883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1818087036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1df1c7-0aca-4930-a946-f29ef22ab938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dd2866c21744679e4b677f6d2beeae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:00Z,use_quota=True,user_id='453ad99248ab4553b228b394b9742895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39302c60-37ad-4b4b-a00d-ca9eb2ae0e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39302c60-37ad-4b4b-a00d-ca9eb2ae0e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb80ab1-1916-4a2e-9334-4353529d57d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afb80ab1-1916-4a2e-9334-4353529d57d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1df1c7-0aca-4930-a946-f29ef22ab938', 'volume_name': 'volume-4a1df1c7-0aca-4930-a946-f29ef22ab938', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d62fbd-ad4f-4740-a4f9-2f09b496c33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d62fbd-ad4f-4740-a4f9-2f09b496c33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bca26f-22ce-4a77-b9a2-aea8cd8f8059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:00 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Volume 4a1df1c7-0aca-4930-a946-f29ef22ab938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1df1c7-0aca-4930-a946-f29ef22ab938', 'volume_size': 1}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:00 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2 1073741824" returned: 0 in 1.234s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:01 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2
Jul 07 22:32:01 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:01 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2" returned: 0 in 1.013s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] <== create_volume: return (2318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.624s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1818087036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1df1c7-0aca-4930-a946-f29ef22ab938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87dd2866c21744679e4b677f6d2beeae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:00Z,use_quota=True,user_id='453ad99248ab4553b228b394b9742895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Creating volume 4a1df1c7-0aca-4930-a946-f29ef22ab938 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:32:02 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (555b227f-f74b-4a99-bf7d-43e40f29479b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da47e910-5799-4c3b-98f8-60c17ddf96b2', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:02 devstack sudo[88965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 1073741824
Jul 07 22:32:02 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db828124-f37b-48c7-834b-c0281efdd512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:02 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Volume volume-da47e910-5799-4c3b-98f8-60c17ddf96b2 (da47e910-5799-4c3b-98f8-60c17ddf96b2): created successfully
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db828124-f37b-48c7-834b-c0281efdd512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Flow 'volume_create_manager' (55d32497-2c39-4693-8612-df34579e3f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:32:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b0efc8ac-9689-47ce-afa3-2557ec3245af tempest-TaggedAttachmentsTest-1830096924 None] Created volume successfully.
Jul 07 22:32:03 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 1073741824" returned: 0 in 1.883s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:04 devstack sudo[88988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938
Jul 07 22:32:04 devstack sudo[88988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:05 devstack sudo[88988]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938" returned: 0 in 1.581s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] <== create_volume: return (3569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:32:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.583s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23bca26f-22ce-4a77-b9a2-aea8cd8f8059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1df1c7-0aca-4930-a946-f29ef22ab938', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21921a9-7461-425d-8308-476fd1bf2d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:05 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Volume volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 (4a1df1c7-0aca-4930-a946-f29ef22ab938): created successfully
Jul 07 22:32:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21921a9-7461-425d-8308-476fd1bf2d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Flow 'volume_create_manager' (a05fbf56-04ea-4be5-b567-e5ea557e8475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:32:05 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-731f234c-6b86-4b1f-8388-7fc5575da891 req-e325b7fe-369b-4309-bf0b-48162280953d tempest-VolumesSnapshotsTestJSON-1762767594 None] Created volume successfully.
Jul 07 22:32:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Creating offline snapshot 6f730628-3139-4f94-aa79-1054d63cb6da of volume 4a1df1c7-0aca-4930-a946-f29ef22ab938 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:32:07 devstack cinder-volume[88077]: INFO oslo.privsep.daemon [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0_3hqgbz/privsep.sock']
Jul 07 22:32:07 devstack sudo[88992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0_3hqgbz/privsep.sock
Jul 07 22:32:07 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:08 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 07 22:32:08 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 22:32:08 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 07 22:32:08 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 22:32:08 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 07 22:32:08 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 07 22:32:08 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 22:32:08 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 22:32:08 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 07 22:32:10 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 07 22:32:10 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 22:32:10 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 07 22:32:10 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 22:32:10 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 07 22:32:10 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 07 22:32:10 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 22:32:10 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 22:32:10 devstack cinder-volume[88077]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 07 22:32:11 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:11 devstack cinder-volume[88077]: INFO oslo.privsep.daemon [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Spawned new privsep daemon via rootwrap
Jul 07 22:32:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Accepted privsep connection to /tmp/tmp0_3hqgbz/privsep.sock {{(pid=88077) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 07 22:32:11 devstack cinder-volume[88077]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 07 22:32:11 devstack cinder-volume[88077]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 07 22:32:11 devstack cinder-volume[88077]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 07 22:32:11 devstack cinder-volume[88077]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89051
Jul 07 22:32:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25f182f-9feb-4f89-9d9b-081da786cc1b]: (2,) {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:32:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[92785df2-7885-45b3-b973-1ef377da1613]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:32:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:11 devstack sudo[89069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938
Jul 07 22:32:11 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:12 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938" returned: 0 in 1.481s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:13 devstack sudo[89077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da 1G
Jul 07 22:32:13 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:14 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da 1G" returned: 0 in 1.799s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:14 devstack sudo[89083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da
Jul 07 22:32:14 devstack sudo[89083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:15 devstack sudo[89083]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da" returned: 0 in 1.139s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:15 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da is being set with open permissions: ugo+rw
Jul 07 22:32:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:15 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da
Jul 07 22:32:15 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:17 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=6,cinder:SELECT=5,cinder:INSERT=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:32:17 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:32:17 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da" returned: 0 in 1.561s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:17 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.info
Jul 07 22:32:17 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:18 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.info" returned: 0 in 1.069s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:18 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.info is being set with open permissions: ugo+rw
Jul 07 22:32:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:18 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.info
Jul 07 22:32:18 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:19 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.info" returned: 0 in 1.095s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 12.801s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:19 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-a49ae7d6-d7eb-4917-ac86-30f532f8ca87 req-979de87a-b3c9-46bf-9f0d-d09aeb2ca702 tempest-VolumesSnapshotsTestJSON-1762767594 None] Create snapshot completed successfully
Jul 07 22:32:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Acquiring lock "cinder-6f730628-3139-4f94-aa79-1054d63cb6da-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:32:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "cinder-6f730628-3139-4f94-aa79-1054d63cb6da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:32:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Acquiring lock "cinder-quobyte-4a1df1c7-0aca-4930-a946-f29ef22ab938" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:32:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "cinder-quobyte-4a1df1c7-0aca-4930-a946-f29ef22ab938" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:32:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Acquiring lock "cinder-quobyte-6f730628-3139-4f94-aa79-1054d63cb6da" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:32:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "cinder-quobyte-6f730628-3139-4f94-aa79-1054d63cb6da" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:32:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Deleting offline snapshot 6f730628-3139-4f94-aa79-1054d63cb6da of volume 4a1df1c7-0aca-4930-a946-f29ef22ab938 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:32:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] snapshot_file for this snap is: volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:32:20 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8992757e-878e-41b0-9a4c-6b7ea29c168f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:32:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:20 devstack sudo[89157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da
Jul 07 22:32:20 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:21 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da" returned: 0 in 0.855s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a1df1c7-0aca-4930-a946-f29ef22ab938(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:32:21 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6b1633-4b7d-4d5d-8af6-6859e3b8da21]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:32:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:21 devstack sudo[89164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938
Jul 07 22:32:21 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:22 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938" returned: 0 in 0.858s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:22 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da
Jul 07 22:32:22 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da" returned: 0 in 0.882s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:23 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:23 devstack sudo[89196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da
Jul 07 22:32:23 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:24 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938.6f730628-3139-4f94-aa79-1054d63cb6da" returned: 0 in 1.486s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "cinder-quobyte-6f730628-3139-4f94-aa79-1054d63cb6da" released by "_delete_snapshot" :: held 4.243s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:32:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "cinder-quobyte-4a1df1c7-0aca-4930-a946-f29ef22ab938" released by "delete_snapshot" :: held 4.268s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:32:24 devstack cinder-volume[88077]: WARNING cinder.quota [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:32:24 devstack cinder-volume[88077]: WARNING cinder.quota [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:32:25 devstack cinder-volume[88077]: DEBUG cinder.quota [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Created reservations ['f26d79b5-7525-4ffa-b8e2-da18eba605c6', 'b3acca53-fbb7-4b53-973d-a2de2977b33b', '16bc486f-c78c-4c61-bea4-03e47c2c83c0', '11e8c928-70ef-44f9-9b67-35d8ce48df5d'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:32:25 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Delete snapshot completed successfully.
Jul 07 22:32:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-290aa27e-22f8-4ee6-96a9-f6ff13156b30 req-31f8bfea-6647-4b3f-8b45-1ebc36fd42ea tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "cinder-6f730628-3139-4f94-aa79-1054d63cb6da-delete_snapshot" released by "delete_snapshot" :: held 4.468s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:32:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Acquiring lock "cinder-4a1df1c7-0aca-4930-a946-f29ef22ab938-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:32:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "cinder-4a1df1c7-0aca-4930-a946-f29ef22ab938-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:32:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Acquiring lock "cinder-quobyte-4a1df1c7-0aca-4930-a946-f29ef22ab938" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:32:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "cinder-quobyte-4a1df1c7-0aca-4930-a946-f29ef22ab938" acquired by "delete_volume" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:32:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2351d25-6d75-4481-8d21-44d48c1bb39d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:32:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:25 devstack sudo[89250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938
Jul 07 22:32:25 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:27 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938" returned: 0 in 1.568s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:27 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938
Jul 07 22:32:27 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Flow 'volume_create_manager' (a452de42-72bd-4d92-9cac-49de2d86bc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c474e7-dffe-4114-bf8a-50b2216740f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44c474e7-dffe-4114-bf8a-50b2216740f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-241502328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf962f1-e6e8-49bc-ae30-d8fdca9375f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f29303571fc468a95cee9622c6a780a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:28Z,use_quota=True,user_id='58833635d05a462d8ab8a950ae8da040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06029bb9-b427-45c7-af22-fc82187735e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06029bb9-b427-45c7-af22-fc82187735e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e8d9c8-c6ab-4f44-8e88-c3dd022215e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e8d9c8-c6ab-4f44-8e88-c3dd022215e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf962f1-e6e8-49bc-ae30-d8fdca9375f9', 'volume_name': 'volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc8cbfd-310d-4ecb-be72-f86cae85f98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc8cbfd-310d-4ecb-be72-f86cae85f98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3307f384-7645-4e11-9b86-a4dc3fec46e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:28 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Volume 8bf962f1-e6e8-49bc-ae30-d8fdca9375f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9', 'volume_size': 1}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-241502328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf962f1-e6e8-49bc-ae30-d8fdca9375f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f29303571fc468a95cee9622c6a780a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:28Z,use_quota=True,user_id='58833635d05a462d8ab8a950ae8da040',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Creating volume 8bf962f1-e6e8-49bc-ae30-d8fdca9375f9 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:32:28 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:32:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:28 devstack sudo[89280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9 1073741824
Jul 07 22:32:28 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:29 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4a1df1c7-0aca-4930-a946-f29ef22ab938" returned: 0 in 1.780s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "cinder-quobyte-4a1df1c7-0aca-4930-a946-f29ef22ab938" released by "delete_volume" :: held 3.467s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:32:29 devstack cinder-volume[88077]: WARNING cinder.quota [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:32:29 devstack cinder-volume[88077]: DEBUG cinder.quota [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Created reservations ['df8db188-0534-4d21-a20f-10a7a0e7105c', '1d693c84-3810-494d-9405-4f74f913cb44', 'eb1d764c-c141-4c6c-af8f-a0415f399f91', '938e9dc0-54a7-438b-9968-607660e0823c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:32:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:29 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:32:29 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:30 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9 1073741824" returned: 0 in 1.662s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:30 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9
Jul 07 22:32:30 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:31 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.708s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:31 devstack cinder-volume[88077]: DEBUG cinder.manager [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:32:31 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Deleted volume successfully.
Jul 07 22:32:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-35a2c86c-9253-4787-af52-0b4a1b177d96 req-f23cc17e-85bf-433b-9eec-f9bec7a29d7d tempest-VolumesSnapshotsTestJSON-1762767594 None] Lock "cinder-4a1df1c7-0aca-4930-a946-f29ef22ab938-delete_volume" released by "delete_volume" :: held 5.811s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:32:31 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9" returned: 0 in 1.603s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] <== create_volume: return (3409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:32:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.412s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3307f384-7645-4e11-9b86-a4dc3fec46e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f95d64-6bb0-46fd-abe2-a30ad79a1035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:31 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Volume volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9 (8bf962f1-e6e8-49bc-ae30-d8fdca9375f9): created successfully
Jul 07 22:32:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f95d64-6bb0-46fd-abe2-a30ad79a1035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Flow 'volume_create_manager' (a452de42-72bd-4d92-9cac-49de2d86bc29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:32:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1329397b-6bb3-408e-8a29-84e941a235e1 tempest-ServerRescueNegativeTestJSON-32234360 None] Created volume successfully.
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Flow 'volume_create_manager' (2ef203f4-dd43-4def-a0ce-c66721a4fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dff7e6-960e-4e08-bda8-ff409b836820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dff7e6-960e-4e08-bda8-ff409b836820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1788424077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f1b94f-dba1-454d-9800-fc1a17fac02b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='edae3d42314e4db0865fd2f8a6980483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:40Z,use_quota=True,user_id='894b26c825bc4a2d96c0bd1ef84db689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce1e014-8df2-4acf-854a-76bf190546b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce1e014-8df2-4acf-854a-76bf190546b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3018a42b-684f-4a7c-849b-0063495d5d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3018a42b-684f-4a7c-849b-0063495d5d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19f1b94f-dba1-454d-9800-fc1a17fac02b', 'volume_name': 'volume-19f1b94f-dba1-454d-9800-fc1a17fac02b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f530f1b-fa11-4935-87d9-990102cc36c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f530f1b-fa11-4935-87d9-990102cc36c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a5906e-cc69-49a1-a3bb-f63043be40b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:40 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Volume 19f1b94f-dba1-454d-9800-fc1a17fac02b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19f1b94f-dba1-454d-9800-fc1a17fac02b', 'volume_size': 1}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1788424077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19f1b94f-dba1-454d-9800-fc1a17fac02b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='edae3d42314e4db0865fd2f8a6980483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:32:40Z,use_quota=True,user_id='894b26c825bc4a2d96c0bd1ef84db689',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Creating volume 19f1b94f-dba1-454d-9800-fc1a17fac02b {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:32:40 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:32:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:40 devstack sudo[89307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b 1073741824
Jul 07 22:32:40 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:41 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b 1073741824" returned: 0 in 1.365s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:41 devstack sudo[89337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b
Jul 07 22:32:41 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:42 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b" returned: 0 in 1.078s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] <== create_volume: return (2558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:32:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.561s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a5906e-cc69-49a1-a3bb-f63043be40b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19f1b94f-dba1-454d-9800-fc1a17fac02b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62058788-4131-4ee0-90c0-6be06c779c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:32:42 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Volume volume-19f1b94f-dba1-454d-9800-fc1a17fac02b (19f1b94f-dba1-454d-9800-fc1a17fac02b): created successfully
Jul 07 22:32:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62058788-4131-4ee0-90c0-6be06c779c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:32:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Flow 'volume_create_manager' (2ef203f4-dd43-4def-a0ce-c66721a4fad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:32:42 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-f7245730-6139-497e-9e43-d0c24af00db0 req-753c5f26-e0f5-4dd4-b794-5f6898c109c2 tempest-VolumesGetTestJSON-730207110 None] Created volume successfully.
Jul 07 22:32:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:32:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:43 devstack sudo[89348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:32:43 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Acquiring lock "cinder-19f1b94f-dba1-454d-9800-fc1a17fac02b-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Lock "cinder-19f1b94f-dba1-454d-9800-fc1a17fac02b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Acquiring lock "cinder-quobyte-19f1b94f-dba1-454d-9800-fc1a17fac02b" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Lock "cinder-quobyte-19f1b94f-dba1-454d-9800-fc1a17fac02b" acquired by "delete_volume" :: waited 0.039s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64ed0c3-257a-49e2-8f05-b8e26e761af6]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:44 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.851s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 8 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:32:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:32:44 devstack sudo[89351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b
Jul 07 22:32:44 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:45 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b" returned: 0 in 1.092s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:45 devstack sudo[89379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b
Jul 07 22:32:45 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:46 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19f1b94f-dba1-454d-9800-fc1a17fac02b" returned: 0 in 1.199s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Lock "cinder-quobyte-19f1b94f-dba1-454d-9800-fc1a17fac02b" released by "delete_volume" :: held 2.380s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:32:46 devstack cinder-volume[88077]: DEBUG cinder.quota [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Created reservations ['50b1ca18-4db9-4965-87c4-69baf1fa1c18', 'fa16b204-c9ef-4dd5-b521-b5216a9f8cbe', '01ac72be-ac18-4fca-af90-c41465f29522', 'd86f010d-b3ca-4819-8217-156f08ac8aa8'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:32:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:46 devstack sudo[89384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:32:46 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:48 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.861s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:48 devstack cinder-volume[88077]: DEBUG cinder.manager [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:32:48 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Deleted volume successfully.
Jul 07 22:32:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-7832c961-f809-4bbe-9c1a-084ff88eeb3c req-01ac731b-991a-4bf7-b862-2243a7908272 tempest-VolumesGetTestJSON-730207110 None] Lock "cinder-19f1b94f-dba1-454d-9800-fc1a17fac02b-delete_volume" released by "delete_volume" :: held 4.748s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:32:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Acquiring lock "cinder-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:32:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Lock "cinder-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:32:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Acquiring lock "cinder-quobyte-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:32:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Lock "cinder-quobyte-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9" acquired by "delete_volume" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:32:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8d987a-12c8-434c-9cd5-61573365872b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:32:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:55 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9
Jul 07 22:32:55 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:57 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9" returned: 0 in 1.706s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:57 devstack sudo[89442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9
Jul 07 22:32:57 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:57 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-aa456faa-503c-4a62-9cc3-f1ffe6f1c3ef tempest-GroupSnapshotsTest-93294595 None] Group tempest-GroupSnapshotsTest-Group-607267966: creating
Jul 07 22:32:57 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-aa456faa-503c-4a62-9cc3-f1ffe6f1c3ef tempest-GroupSnapshotsTest-93294595 None] Group tempest-GroupSnapshotsTest-Group-607267966: created successfully
Jul 07 22:32:57 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-aa456faa-503c-4a62-9cc3-f1ffe6f1c3ef tempest-GroupSnapshotsTest-93294595 None] Create group completed successfully.
Jul 07 22:32:58 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9" returned: 0 in 1.045s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Lock "cinder-quobyte-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9" released by "delete_volume" :: held 2.830s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:32:58 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Created reservations ['f653bc0e-8035-4477-af92-548ccf75a385', '0d57ff4b-1753-4f7b-b1b0-a078f648ab16', 'db56c992-9a38-48aa-9318-b9b0924f1da1', 'a7d7545a-fb5c-463f-8a10-eac8d0867a32'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:32:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:58 devstack sudo[89457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:32:58 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:59 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:32:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Flow 'volume_create_manager' (c2dc4b1d-44f1-4fc5-99ad-62c635e2f616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:32:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01132e4d-17f3-4017-9d8b-e2f8f07bbd75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01132e4d-17f3-4017-9d8b-e2f8f07bbd75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-52297806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f23e4e89-6663-4009-b1c4-6674e62a5e14,host='devstack@QuobyteHD#QuobyteHD',id=b7b481e7-d057-4d66-83c2-d3ca59b377c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0330c16497d414793e80bd5de8b9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:00Z,use_quota=True,user_id='f8d80d3e29ff4888a9e178d228b1bb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3078bc1-5271-4bc5-9adb-8df0e950f040),volume_type_id=a3078bc1-5271-4bc5-9adb-8df0e950f040)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa80dbad-b0ce-40ab-8ae6-20d7663246ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa80dbad-b0ce-40ab-8ae6-20d7663246ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:00 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675483eb-c3ae-4426-81b1-923516895794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675483eb-c3ae-4426-81b1-923516895794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7b481e7-d057-4d66-83c2-d3ca59b377c5', 'volume_name': 'volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a53c7e9-d874-4159-895f-175fca80603e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a53c7e9-d874-4159-895f-175fca80603e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3b5b48-623d-4784-b601-42902d03c936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:00 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Volume b7b481e7-d057-4d66-83c2-d3ca59b377c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5', 'volume_size': 1}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f23e4e89-6663-4009-b1c4-6674e62a5e14,created_at=2026-07-07T20:32:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-52297806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f23e4e89-6663-4009-b1c4-6674e62a5e14,host='devstack@QuobyteHD#QuobyteHD',id=b7b481e7-d057-4d66-83c2-d3ca59b377c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0330c16497d414793e80bd5de8b9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:00Z,use_quota=True,user_id='f8d80d3e29ff4888a9e178d228b1bb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3078bc1-5271-4bc5-9adb-8df0e950f040),volume_type_id=a3078bc1-5271-4bc5-9adb-8df0e950f040)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Creating volume b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:33:00 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.709s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:33:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Deleted volume successfully.
Jul 07 22:33:00 devstack sudo[89484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 1073741824
Jul 07 22:33:00 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-428bd011-095f-493a-9831-be5c9d8c72ce tempest-ServerRescueNegativeTestJSON-32234360 None] Lock "cinder-8bf962f1-e6e8-49bc-ae30-d8fdca9375f9-delete_volume" released by "delete_volume" :: held 4.878s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:01 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 1073741824" returned: 0 in 1.578s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:01 devstack sudo[89514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5
Jul 07 22:33:01 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:02 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5" returned: 0 in 1.022s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] <== create_volume: return (2682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:33:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.684s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3b5b48-623d-4784-b601-42902d03c936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc44f5cf-6b37-4618-8c0a-9e3c52f3f7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:02 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Volume volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 (b7b481e7-d057-4d66-83c2-d3ca59b377c5): created successfully
Jul 07 22:33:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc44f5cf-6b37-4618-8c0a-9e3c52f3f7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Flow 'volume_create_manager' (c2dc4b1d-44f1-4fc5-99ad-62c635e2f616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-23df6375-32a1-44f3-bc71-3edf847596b6 tempest-GroupSnapshotsTest-93294595 None] Created volume successfully.
Jul 07 22:33:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] GroupSnapshot 2394307d-e597-42c1-ab87-e671962a01b8: creating.
Jul 07 22:33:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Group snapshot 2394307d-e597-42c1-ab87-e671962a01b8: creating. {{(pid=88077) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 22:33:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Creating offline snapshot 8a740a6d-69f2-4774-a7e8-258e003f406e of volume b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:33:04 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2216cb-07f2-42a3-b0f8-29a692b4a991]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:04 devstack sudo[89555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5
Jul 07 22:33:04 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:05 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5" returned: 0 in 1.049s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:05 devstack sudo[89560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e 1G
Jul 07 22:33:05 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:06 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e 1G" returned: 0 in 1.321s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:06 devstack sudo[89566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e
Jul 07 22:33:06 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:08 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e" returned: 0 in 1.333s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:08 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:33:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:08 devstack sudo[89574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e
Jul 07 22:33:08 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:09 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e" returned: 0 in 0.813s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:09 devstack sudo[89580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.info
Jul 07 22:33:09 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:09 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.info" returned: 0 in 0.737s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:09 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:33:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:09 devstack sudo[89585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.info
Jul 07 22:33:09 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:10 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.info" returned: 0 in 0.736s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.119s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:10 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3123cd10-4f1c-492f-a1ad-e0670d6dae71 tempest-GroupSnapshotsTest-93294595 None] group_snapshot 2394307d-e597-42c1-ab87-e671962a01b8: created successfully
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-8a740a6d-69f2-4774-a7e8-258e003f406e-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" by "_create_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-8a740a6d-69f2-4774-a7e8-258e003f406e-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Creating volume 1707c9ea-a986-4f59-a030-ea9fcc0e02f7 from snapshot 8a740a6d-69f2-4774-a7e8-258e003f406e {{(pid=88077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] snapshot: 8a740a6d-69f2-4774-a7e8-258e003f406e, volume: 1707c9ea-a986-4f59-a030-ea9fcc0e02f7,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1f8e25-72fb-4aa5-84ab-f799a4c98e98]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:12 devstack sudo[89590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e
Jul 07 22:33:12 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:13 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e" returned: 0 in 1.316s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:33:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:33:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:33:13 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b9a172-6ff5-4194-9773-b5013962ff09]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:13 devstack sudo[89657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5
Jul 07 22:33:13 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:14 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5" returned: 0 in 0.972s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:14 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7 not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:33:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:14 devstack sudo[89670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7
Jul 07 22:33:14 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:21 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" returned: 0 in 6.723s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:21 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac31268-7a6c-4a0b-a21f-d844d43e4c00]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:21 devstack sudo[89711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5
Jul 07 22:33:21 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:22 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=39,cinder:INSERT=12,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:33:22 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=40,cinder:UPDATE=38,cinder:DELETE=4,cinder:INSERT=9 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:33:22 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5" returned: 0 in 1.250s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:22 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:33:22 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Converted 1024.00 MB image at 152.27 MB/s
Jul 07 22:33:22 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:33:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:22 devstack sudo[89721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7
Jul 07 22:33:22 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:23 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" returned: 0 in 1.081s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" released by "_copy_volume_from_snapshot" :: held 11.506s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-8a740a6d-69f2-4774-a7e8-258e003f406e-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" released by "_create_volume_from_snapshot" :: held 11.550s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.569s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:23 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ad846310-fcae-4876-aadb-8192ba299849 tempest-GroupSnapshotsTest-93294595 None] Create group from source-snapshot-2394307d-e597-42c1-ab87-e671962a01b8 completed successfully.
Jul 07 22:33:25 devstack cinder-volume[88077]: WARNING py.warnings [req-67c794d7-bacd-49a2-a158-69619098d5d3 req-b3e6137c-d588-4826-905f-2b63fa727e2a tempest-TaggedAttachmentsTest-1830096924 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jul 07 22:33:25 devstack cinder-volume[88077]:   .first()
Jul 07 22:33:25 devstack cinder-volume[88077]: 
Jul 07 22:33:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-67c794d7-bacd-49a2-a158-69619098d5d3 req-b3e6137c-d588-4826-905f-2b63fa727e2a tempest-TaggedAttachmentsTest-1830096924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-67c794d7-bacd-49a2-a158-69619098d5d3 req-b3e6137c-d588-4826-905f-2b63fa727e2a tempest-TaggedAttachmentsTest-1830096924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba58ded-345e-4307-a77f-b92a76ebdb52]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-67c794d7-bacd-49a2-a158-69619098d5d3 req-b3e6137c-d588-4826-905f-2b63fa727e2a tempest-TaggedAttachmentsTest-1830096924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:25 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2
Jul 07 22:33:25 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" acquired by "delete_volume" :: waited 0.033s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6964cb0b-a0eb-464e-85cb-369390dcd9e6]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:25 devstack sudo[89744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7
Jul 07 22:33:25 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:26 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-67c794d7-bacd-49a2-a158-69619098d5d3 req-b3e6137c-d588-4826-905f-2b63fa727e2a tempest-TaggedAttachmentsTest-1830096924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2" returned: 0 in 1.124s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-67c794d7-bacd-49a2-a158-69619098d5d3 req-b3e6137c-d588-4826-905f-2b63fa727e2a tempest-TaggedAttachmentsTest-1830096924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.143s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-67c794d7-bacd-49a2-a158-69619098d5d3 req-b3e6137c-d588-4826-905f-2b63fa727e2a tempest-TaggedAttachmentsTest-1830096924 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-da47e910-5799-4c3b-98f8-60c17ddf96b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '674abd5a-4ccf-4eee-940c-846f8bc287c3', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:33:26 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" returned: 0 in 1.065s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:26 devstack sudo[89755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7
Jul 07 22:33:26 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-67c794d7-bacd-49a2-a158-69619098d5d3 req-b3e6137c-d588-4826-905f-2b63fa727e2a tempest-TaggedAttachmentsTest-1830096924 None] attachment_update completed successfully.
Jul 07 22:33:27 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" returned: 0 in 0.800s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-1707c9ea-a986-4f59-a030-ea9fcc0e02f7" released by "delete_volume" :: held 1.938s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:27 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Created reservations ['1eb63f2b-8a71-4067-86d8-ab2ddef5fa2c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:33:27 devstack cinder-volume[88077]: WARNING cinder.quota [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1798453833 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1798453833, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:33:27 devstack cinder-volume[88077]: WARNING cinder.quota [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1798453833 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1798453833, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:33:27 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Created reservations ['f8011fe6-1144-4970-b186-c58f6916824e', '8188ab2a-fac3-450b-9394-0db192f8116f', 'f8dcbe13-57bd-459e-97db-348ab58af4f3', '58561b90-ed69-4362-ac38-87a0e27a7552'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:33:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:27 devstack sudo[89826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:33:27 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] group_snapshot 2394307d-e597-42c1-ab87-e671962a01b8: deleting
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] group_snapshot 2394307d-e597-42c1-ab87-e671962a01b8: deleting {{(pid=88077) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-b7b481e7-d057-4d66-83c2-d3ca59b377c5" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-b7b481e7-d057-4d66-83c2-d3ca59b377c5" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-8a740a6d-69f2-4774-a7e8-258e003f406e" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-8a740a6d-69f2-4774-a7e8-258e003f406e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Deleting offline snapshot 8a740a6d-69f2-4774-a7e8-258e003f406e of volume b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] snapshot_file for this snap is: volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d42e177-f057-4c05-9cb8-587eee59a825]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:28 devstack sudo[90145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e
Jul 07 22:33:28 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:28 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.931s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:28 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:33:28 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f0d7f978-2d19-4e84-9869-b3f6082ca2fe tempest-GroupSnapshotsTest-93294595 None] Delete group completed successfully.
Jul 07 22:33:29 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e" returned: 0 in 0.888s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:33:29 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca37155-9280-478d-9932-206e4460730d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:29 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5
Jul 07 22:33:29 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:30 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5" returned: 0 in 1.081s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:30 devstack sudo[90158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e
Jul 07 22:33:30 devstack sudo[90158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:31 devstack sudo[90158]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e" returned: 0 in 1.290s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:31 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e
Jul 07 22:33:31 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:32 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5.8a740a6d-69f2-4774-a7e8-258e003f406e" returned: 0 in 1.131s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-8a740a6d-69f2-4774-a7e8-258e003f406e" released by "_delete_snapshot" :: held 4.554s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-b7b481e7-d057-4d66-83c2-d3ca59b377c5" released by "delete_snapshot" :: held 4.599s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:32 devstack cinder-volume[88077]: WARNING cinder.quota [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1798453833 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1798453833, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:33:32 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['b41fe9de-dd18-4025-be86-a28f20a8fc9c', '36128e06-e29d-49d7-a75b-7afcf0f57118', '85fbd131-e61c-4d2c-a235-99919d9a936e', '207f1679-9170-4fcb-b6e5-f6282563cc53'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:33:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-31384f4d-d3c9-4b62-8333-193af4fb5f79 tempest-GroupSnapshotsTest-93294595 None] group_snapshot 2394307d-e597-42c1-ab87-e671962a01b8: deleted successfully
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Flow 'volume_create_manager' (6c731304-a3ff-42d0-b4ee-f48a96a31857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e07213c-e430-48f1-bfdc-57119a51f92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e07213c-e430-48f1-bfdc-57119a51f92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2134367851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950159d5-c0e6-4d78-9b76-d12631cb55e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed27d8f9fc948838fe6b1e37a331e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:34Z,use_quota=True,user_id='6e556e6c30f744b2ac7ef2340181c2a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba4c14b-afc6-4da4-86a4-fa917b9a9c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba4c14b-afc6-4da4-86a4-fa917b9a9c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08d7f1e-a842-44fb-843e-9be881ac9ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08d7f1e-a842-44fb-843e-9be881ac9ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950159d5-c0e6-4d78-9b76-d12631cb55e2', 'volume_name': 'volume-950159d5-c0e6-4d78-9b76-d12631cb55e2', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73581ba-2caf-4bb7-80be-de9ffdea12f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a73581ba-2caf-4bb7-80be-de9ffdea12f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce282bb4-9e4a-4eb2-a845-c4fabb88f63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Volume 950159d5-c0e6-4d78-9b76-d12631cb55e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950159d5-c0e6-4d78-9b76-d12631cb55e2', 'volume_size': 1}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2134367851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950159d5-c0e6-4d78-9b76-d12631cb55e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed27d8f9fc948838fe6b1e37a331e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:34Z,use_quota=True,user_id='6e556e6c30f744b2ac7ef2340181c2a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Creating volume 950159d5-c0e6-4d78-9b76-d12631cb55e2 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:33:33 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:33:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:33 devstack sudo[90195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2 1073741824
Jul 07 22:33:33 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-b7b481e7-d057-4d66-83c2-d3ca59b377c5" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-b7b481e7-d057-4d66-83c2-d3ca59b377c5" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:34 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c43612-b348-45ac-861c-4ae1b321c087]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:34 devstack sudo[90197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5
Jul 07 22:33:34 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:34 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-bc824558-9281-4b0c-b844-65812032fe0c req-e7ab16fd-233d-4ca3-9d7d-ddaedc567767 tempest-TaggedAttachmentsTest-1830096924 None] Terminate volume connection completed successfully.
Jul 07 22:33:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-bc824558-9281-4b0c-b844-65812032fe0c req-e7ab16fd-233d-4ca3-9d7d-ddaedc567767 tempest-TaggedAttachmentsTest-1830096924 None] Deleting attachment 674abd5a-4ccf-4eee-940c-846f8bc287c3. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:33:35 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2 1073741824" returned: 0 in 1.090s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:35 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5" returned: 0 in 0.941s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:35 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5
Jul 07 22:33:35 devstack sudo[90235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2
Jul 07 22:33:35 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:35 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:35 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2" returned: 0 in 0.709s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce282bb4-9e4a-4eb2-a845-c4fabb88f63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950159d5-c0e6-4d78-9b76-d12631cb55e2', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47272e43-5e7b-4df4-bd81-122fdbcc5a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:35 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b7b481e7-d057-4d66-83c2-d3ca59b377c5" returned: 0 in 0.768s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:35 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Volume volume-950159d5-c0e6-4d78-9b76-d12631cb55e2 (950159d5-c0e6-4d78-9b76-d12631cb55e2): created successfully
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47272e43-5e7b-4df4-bd81-122fdbcc5a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Flow 'volume_create_manager' (6c731304-a3ff-42d0-b4ee-f48a96a31857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-b7b481e7-d057-4d66-83c2-d3ca59b377c5" released by "delete_volume" :: held 1.809s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:35 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-87385e4b-ab69-4ec1-bb1d-e7fa970347f4 tempest-VolumesTestJSON-928020857 None] Created volume successfully.
Jul 07 22:33:35 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['38cc3da8-480b-464a-8756-85f1ef28412a'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:33:36 devstack cinder-volume[88077]: WARNING cinder.db.api [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1798453833']
Jul 07 22:33:36 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['e17409d8-4733-4eaa-85b0-a5efad0e7850', 'df7a8b6d-a99d-4e04-ab6c-630c353cf999', 'b48214c7-8c25-4c2f-bcac-aaccd24f0eaa', '76c3a614-18ef-476a-b73b-4e27ff20aed5'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:33:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:36 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:33:36 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.152s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:37 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:33:37 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-74dbaea7-7f45-4f9b-b454-fc6a513afe01 tempest-GroupSnapshotsTest-93294595 None] Delete group completed successfully.
Jul 07 22:33:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d50e6b8a-4b5a-4bb3-966c-b911e1740b8d tempest-GroupSnapshotsTest-93294595 None] Group tempest-GroupSnapshotsTest-Group-1576106538: creating
Jul 07 22:33:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d50e6b8a-4b5a-4bb3-966c-b911e1740b8d tempest-GroupSnapshotsTest-93294595 None] Group tempest-GroupSnapshotsTest-Group-1576106538: created successfully
Jul 07 22:33:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d50e6b8a-4b5a-4bb3-966c-b911e1740b8d tempest-GroupSnapshotsTest-93294595 None] Create group completed successfully.
Jul 07 22:33:37 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Flow 'volume_create_manager' (2e252c17-3024-4371-93cb-243e876677b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6982ebe3-4885-4101-9f1c-d097df5d5995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6982ebe3-4885-4101-9f1c-d097df5d5995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1053356931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d648b711-3d40-43a8-b3eb-276816a3de85,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed27d8f9fc948838fe6b1e37a331e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:38Z,use_quota=True,user_id='6e556e6c30f744b2ac7ef2340181c2a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038c0fec-4e48-45b7-8639-26c872619e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038c0fec-4e48-45b7-8639-26c872619e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee8ed5b-1c7b-4ff7-ad42-2e171b54487c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee8ed5b-1c7b-4ff7-ad42-2e171b54487c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd648b711-3d40-43a8-b3eb-276816a3de85', 'volume_name': 'volume-d648b711-3d40-43a8-b3eb-276816a3de85', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c3ce28-63e0-4ee9-839f-72268131c9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c3ce28-63e0-4ee9-839f-72268131c9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ec7ecb-0920-4369-a225-169aeed6a01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:38 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Volume d648b711-3d40-43a8-b3eb-276816a3de85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d648b711-3d40-43a8-b3eb-276816a3de85', 'volume_size': 1}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1053356931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d648b711-3d40-43a8-b3eb-276816a3de85,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed27d8f9fc948838fe6b1e37a331e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:38Z,use_quota=True,user_id='6e556e6c30f744b2ac7ef2340181c2a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Creating volume d648b711-3d40-43a8-b3eb-276816a3de85 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:33:38 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:33:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:38 devstack sudo[90326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85 1073741824
Jul 07 22:33:38 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:39 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85 1073741824" returned: 0 in 1.365s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Flow 'volume_create_manager' (b004a8a0-ea62-4d8f-9a2b-cb697aa987f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2569e658-a286-4eff-879e-099a72dc2de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:39 devstack sudo[90337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85
Jul 07 22:33:39 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2569e658-a286-4eff-879e-099a72dc2de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-159497075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6659c1d-e1fd-495f-bf07-646e411f4f90,host='devstack@QuobyteHD#QuobyteHD',id=0993d806-7ed5-443b-8118-6c2966d11246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0330c16497d414793e80bd5de8b9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:39Z,use_quota=True,user_id='f8d80d3e29ff4888a9e178d228b1bb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36728e3f-190c-476c-b001-dc83ea3088eb),volume_type_id=36728e3f-190c-476c-b001-dc83ea3088eb)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba7ec61-9ad1-4867-9aef-affbec6b113b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fba7ec61-9ad1-4867-9aef-affbec6b113b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e757a6e-264d-475e-ace3-8da00b73f2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e757a6e-264d-475e-ace3-8da00b73f2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0993d806-7ed5-443b-8118-6c2966d11246', 'volume_name': 'volume-0993d806-7ed5-443b-8118-6c2966d11246', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e82b89a-4ab0-4ae2-b14b-40cc46e23d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e82b89a-4ab0-4ae2-b14b-40cc46e23d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eb84e8-65bd-40db-87fc-685f8e68fd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:39 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Volume 0993d806-7ed5-443b-8118-6c2966d11246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0993d806-7ed5-443b-8118-6c2966d11246', 'volume_size': 1}
Jul 07 22:33:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:40 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85" returned: 0 in 0.744s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] <== create_volume: return (2224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.227s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b6659c1d-e1fd-495f-bf07-646e411f4f90,created_at=2026-07-07T20:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-159497075',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6659c1d-e1fd-495f-bf07-646e411f4f90,host='devstack@QuobyteHD#QuobyteHD',id=0993d806-7ed5-443b-8118-6c2966d11246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0330c16497d414793e80bd5de8b9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:39Z,use_quota=True,user_id='f8d80d3e29ff4888a9e178d228b1bb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36728e3f-190c-476c-b001-dc83ea3088eb),volume_type_id=36728e3f-190c-476c-b001-dc83ea3088eb)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Creating volume 0993d806-7ed5-443b-8118-6c2966d11246 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:33:40 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:40 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246 1073741824
Jul 07 22:33:40 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ec7ecb-0920-4369-a225-169aeed6a01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d648b711-3d40-43a8-b3eb-276816a3de85', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9122f5c9-6105-4166-95bd-5c1502e39aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:40 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Volume volume-d648b711-3d40-43a8-b3eb-276816a3de85 (d648b711-3d40-43a8-b3eb-276816a3de85): created successfully
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9122f5c9-6105-4166-95bd-5c1502e39aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Flow 'volume_create_manager' (2e252c17-3024-4371-93cb-243e876677b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:40 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-da0db4f7-6aa2-4cde-83f6-942408c644ba tempest-VolumesTestJSON-928020857 None] Created volume successfully.
Jul 07 22:33:41 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246 1073741824" returned: 0 in 1.187s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:41 devstack sudo[90347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246
Jul 07 22:33:41 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Flow 'volume_create_manager' (aadd7a5a-2151-480c-bda0-e8e00e68918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed6b1e7-7fa9-4bd8-9dbd-d3dbb08133b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ed6b1e7-7fa9-4bd8-9dbd-d3dbb08133b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-250585066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc16bf5-a2f0-4553-a11a-0b8d610ac323,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed27d8f9fc948838fe6b1e37a331e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:42Z,use_quota=True,user_id='6e556e6c30f744b2ac7ef2340181c2a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d235598-aeb3-45ab-bc97-81083a22c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d235598-aeb3-45ab-bc97-81083a22c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa752e87-7b53-4f2f-8ca2-e7a72caa9e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa752e87-7b53-4f2f-8ca2-e7a72caa9e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc16bf5-a2f0-4553-a11a-0b8d610ac323', 'volume_name': 'volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599ae548-4bba-4fca-8b1d-b1f1b870c17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599ae548-4bba-4fca-8b1d-b1f1b870c17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a761c4aa-14ea-403d-a05e-9f7fda7020f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Volume 8fc16bf5-a2f0-4553-a11a-0b8d610ac323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323', 'volume_size': 1}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:42 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246" returned: 0 in 1.030s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] <== create_volume: return (2275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.280s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.409s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-250585066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc16bf5-a2f0-4553-a11a-0b8d610ac323,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4ed27d8f9fc948838fe6b1e37a331e93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:42Z,use_quota=True,user_id='6e556e6c30f744b2ac7ef2340181c2a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Creating volume 8fc16bf5-a2f0-4553-a11a-0b8d610ac323 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:33:42 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:42 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323 1073741824
Jul 07 22:33:42 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04eb84e8-65bd-40db-87fc-685f8e68fd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0993d806-7ed5-443b-8118-6c2966d11246', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8668af03-6a40-4b59-8fe0-6abf53e7fbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Volume volume-0993d806-7ed5-443b-8118-6c2966d11246 (0993d806-7ed5-443b-8118-6c2966d11246): created successfully
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8668af03-6a40-4b59-8fe0-6abf53e7fbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Flow 'volume_create_manager' (b004a8a0-ea62-4d8f-9a2b-cb697aa987f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:42 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-7bdef415-bdeb-4800-be07-af16ed172f10 tempest-GroupSnapshotsTest-93294595 None] Created volume successfully.
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Flow 'volume_create_manager' (b5fefc7b-0e42-4a40-b0cb-379b832dd9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521ac61d-1817-4534-ba5f-1a851d2ba66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521ac61d-1817-4534-ba5f-1a851d2ba66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-301850059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7332993-b228-45d7-b093-aba74002a69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3736aecd02bd4542a7eb0cc29b025213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:43Z,use_quota=True,user_id='14fdb488df8a47199e7ade69a33b22cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7d02cb-ce9e-446a-8e76-5970a245ca68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7d02cb-ce9e-446a-8e76-5970a245ca68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85c0ebc-6501-43de-83c6-7f26fdf65a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85c0ebc-6501-43de-83c6-7f26fdf65a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7332993-b228-45d7-b093-aba74002a69b', 'volume_name': 'volume-d7332993-b228-45d7-b093-aba74002a69b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab25a16-a316-4f59-8c7e-7996a8f265e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab25a16-a316-4f59-8c7e-7996a8f265e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed6d4ff-fb09-4424-af02-41632f74146b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:42 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Volume d7332993-b228-45d7-b093-aba74002a69b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7332993-b228-45d7-b093-aba74002a69b', 'volume_size': 1}
Jul 07 22:33:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:33:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:43 devstack sudo[90362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:33:43 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:43 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323 1073741824" returned: 0 in 1.073s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:43 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323
Jul 07 22:33:43 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Flow 'volume_create_manager' (c963c96c-2070-402f-8919-7f2751057c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad75f5e-77eb-40df-aabe-c1748f13aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad75f5e-77eb-40df-aabe-c1748f13aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2054033157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6659c1d-e1fd-495f-bf07-646e411f4f90,host='devstack@QuobyteHD#QuobyteHD',id=f27be0d3-5a46-4a22-a6ed-48da72df10ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0330c16497d414793e80bd5de8b9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:44Z,use_quota=True,user_id='f8d80d3e29ff4888a9e178d228b1bb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36728e3f-190c-476c-b001-dc83ea3088eb),volume_type_id=36728e3f-190c-476c-b001-dc83ea3088eb)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e979d4d-b7c7-43bb-a7f1-1f5cbc2e7cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e979d4d-b7c7-43bb-a7f1-1f5cbc2e7cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfe92e5-6499-4148-b033-2d3867a2c455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfe92e5-6499-4148-b033-2d3867a2c455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f27be0d3-5a46-4a22-a6ed-48da72df10ee', 'volume_name': 'volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bb2542-537f-46c9-afed-29e677a5140a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2bb2542-537f-46c9-afed-29e677a5140a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be14830-98d0-4754-afca-1786f6be7e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:44 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Volume f27be0d3-5a46-4a22-a6ed-48da72df10ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee', 'volume_size': 1}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:44 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.996s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 8 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:33:44 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323" returned: 0 in 0.925s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-301850059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7332993-b228-45d7-b093-aba74002a69b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3736aecd02bd4542a7eb0cc29b025213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:43Z,use_quota=True,user_id='14fdb488df8a47199e7ade69a33b22cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Creating volume d7332993-b228-45d7-b093-aba74002a69b {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:33:44 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:44 devstack sudo[90374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b 1073741824
Jul 07 22:33:44 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a761c4aa-14ea-403d-a05e-9f7fda7020f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9d5c2f-00ed-4ce6-a613-18c55509a1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:44 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Volume volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323 (8fc16bf5-a2f0-4553-a11a-0b8d610ac323): created successfully
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9d5c2f-00ed-4ce6-a613-18c55509a1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Flow 'volume_create_manager' (aadd7a5a-2151-480c-bda0-e8e00e68918a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:44 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-661e7a97-960d-47fa-b2a0-9a0b5854e1a0 tempest-VolumesTestJSON-928020857 None] Created volume successfully.
Jul 07 22:33:46 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b 1073741824" returned: 0 in 1.343s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:46 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b
Jul 07 22:33:46 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Acquiring lock "cinder-8fc16bf5-a2f0-4553-a11a-0b8d610ac323-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Lock "cinder-8fc16bf5-a2f0-4553-a11a-0b8d610ac323-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Acquiring lock "cinder-quobyte-8fc16bf5-a2f0-4553-a11a-0b8d610ac323" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Lock "cinder-quobyte-8fc16bf5-a2f0-4553-a11a-0b8d610ac323" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:46 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4f04b2-3761-493a-a455-e6e25a891aac]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:47 devstack sudo[90398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323
Jul 07 22:33:47 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:47 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b" returned: 0 in 1.132s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] <== create_volume: return (2557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.560s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.986s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=b6659c1d-e1fd-495f-bf07-646e411f4f90,created_at=2026-07-07T20:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2054033157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=b6659c1d-e1fd-495f-bf07-646e411f4f90,host='devstack@QuobyteHD#QuobyteHD',id=f27be0d3-5a46-4a22-a6ed-48da72df10ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0330c16497d414793e80bd5de8b9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:44Z,use_quota=True,user_id='f8d80d3e29ff4888a9e178d228b1bb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(36728e3f-190c-476c-b001-dc83ea3088eb),volume_type_id=36728e3f-190c-476c-b001-dc83ea3088eb)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Creating volume f27be0d3-5a46-4a22-a6ed-48da72df10ee {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:33:47 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed6d4ff-fb09-4424-af02-41632f74146b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7332993-b228-45d7-b093-aba74002a69b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:47 devstack sudo[90402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee 1073741824
Jul 07 22:33:47 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65f5a79-5616-4e7a-a7e9-7dd3c468fb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:47 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Volume volume-d7332993-b228-45d7-b093-aba74002a69b (d7332993-b228-45d7-b093-aba74002a69b): created successfully
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65f5a79-5616-4e7a-a7e9-7dd3c468fb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Flow 'volume_create_manager' (b5fefc7b-0e42-4a40-b0cb-379b832dd9f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a75956d6-c615-43b3-8415-877647044780 tempest-VolumesAdminNegativeTest-1101800938 None] Created volume successfully.
Jul 07 22:33:48 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323" returned: 0 in 1.539s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:48 devstack sudo[90413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323
Jul 07 22:33:48 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:48 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee 1073741824" returned: 0 in 1.431s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:48 devstack sudo[90416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee
Jul 07 22:33:48 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Acquiring lock "cinder-d7332993-b228-45d7-b093-aba74002a69b-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Lock "cinder-d7332993-b228-45d7-b093-aba74002a69b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Acquiring lock "cinder-quobyte-d7332993-b228-45d7-b093-aba74002a69b" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Lock "cinder-quobyte-d7332993-b228-45d7-b093-aba74002a69b" acquired by "delete_volume" :: waited 0.035s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce759c9-fced-47a5-b5c7-484bb89dfaea]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:49 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8fc16bf5-a2f0-4553-a11a-0b8d610ac323" returned: 0 in 1.017s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:49 devstack sudo[90418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b
Jul 07 22:33:49 devstack sudo[90418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Lock "cinder-quobyte-8fc16bf5-a2f0-4553-a11a-0b8d610ac323" released by "delete_volume" :: held 2.639s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Created reservations ['ba35dddf-16af-474d-823f-437b1af7258a', '62cff0fe-4dd4-44ff-9689-d107613e2b1a', 'beacb58e-a559-438e-880d-0ffabf781f6f', 'fd3b533a-f8ee-4bbf-a633-424925216a96'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:33:49 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee" returned: 0 in 0.932s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] <== create_volume: return (2435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.440s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5be14830-98d0-4754-afca-1786f6be7e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b640518-7b9e-46ea-aa01-b3d3ada48124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:49 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Volume volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee (f27be0d3-5a46-4a22-a6ed-48da72df10ee): created successfully
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b640518-7b9e-46ea-aa01-b3d3ada48124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Flow 'volume_create_manager' (c963c96c-2070-402f-8919-7f2751057c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:49 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-87af9039-813b-466e-b559-8ab09bb284bb tempest-GroupSnapshotsTest-93294595 None] Created volume successfully.
Jul 07 22:33:49 devstack sudo[90423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:33:49 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Acquiring lock "cinder-d648b711-3d40-43a8-b3eb-276816a3de85-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Lock "cinder-d648b711-3d40-43a8-b3eb-276816a3de85-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Acquiring lock "cinder-quobyte-d648b711-3d40-43a8-b3eb-276816a3de85" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Lock "cinder-quobyte-d648b711-3d40-43a8-b3eb-276816a3de85" acquired by "delete_volume" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:50 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dcf6014-d99a-439c-b561-c6bbbed44db3]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:50 devstack sudo[90418]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b" returned: 0 in 1.337s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:50 devstack sudo[90430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b
Jul 07 22:33:50 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:50 devstack sudo[90429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85
Jul 07 22:33:50 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:50 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.109s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:50 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:33:50 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Deleted volume successfully.
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cd88bc6-bb65-4420-9f0c-73f85301e6de tempest-VolumesTestJSON-928020857 None] Lock "cinder-8fc16bf5-a2f0-4553-a11a-0b8d610ac323-delete_volume" released by "delete_volume" :: held 4.318s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:51 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a97e6d2f-e6a0-407c-9542-c61e6c8b0f7a tempest-GroupSnapshotsTest-93294595 None] Update group completed successfully.
Jul 07 22:33:51 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d7332993-b228-45d7-b093-aba74002a69b" returned: 0 in 0.944s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Lock "cinder-quobyte-d7332993-b228-45d7-b093-aba74002a69b" released by "delete_volume" :: held 2.359s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Created reservations ['f7ae320b-8f7f-4ca0-97af-bf8c9e875c3d', '9226c24e-0f3d-44d4-a87a-89c534f1a7ef', '2e4812a3-c803-49ce-861e-943646f01dbb', '1612c731-a87c-4ea2-85f7-6d5fe8612666'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:33:51 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85" returned: 0 in 1.191s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:51 devstack sudo[90438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85
Jul 07 22:33:51 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:51 devstack sudo[90441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:33:51 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:52 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-973492de-9266-4f50-a4a2-6416fe832f1e tempest-GroupSnapshotsTest-93294595 None] Update group completed successfully.
Jul 07 22:33:52 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d648b711-3d40-43a8-b3eb-276816a3de85" returned: 0 in 0.970s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Lock "cinder-quobyte-d648b711-3d40-43a8-b3eb-276816a3de85" released by "delete_volume" :: held 2.258s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:52 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.022s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Created reservations ['9ffd6624-2f0e-47b8-afb0-21ebbd8e3341', 'e5ca503e-39f7-4564-81ac-1c9c13f55e24', '6a93ca6a-7223-4c0e-a35c-ffcf71161814', '2597a994-0bad-4d1f-ad8f-d8df575462e5'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:33:52 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Deleted volume successfully.
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4f9ab3ae-0348-403d-a1d1-35f4202af9cb tempest-VolumesAdminNegativeTest-1101800938 None] Lock "cinder-d7332993-b228-45d7-b093-aba74002a69b-delete_volume" released by "delete_volume" :: held 3.765s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:52 devstack sudo[90484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:33:52 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:53 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d1b03193-322c-4612-b390-2e24fbc8b679 tempest-GroupSnapshotsTest-93294595 None] Update group completed successfully.
Jul 07 22:33:53 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.791s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:53 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:33:53 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Deleted volume successfully.
Jul 07 22:33:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-919df305-2e54-46fe-9c86-c0d7d289f674 tempest-VolumesTestJSON-928020857 None] Lock "cinder-d648b711-3d40-43a8-b3eb-276816a3de85-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Acquiring lock "cinder-950159d5-c0e6-4d78-9b76-d12631cb55e2-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Lock "cinder-950159d5-c0e6-4d78-9b76-d12631cb55e2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Acquiring lock "cinder-quobyte-950159d5-c0e6-4d78-9b76-d12631cb55e2" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Lock "cinder-quobyte-950159d5-c0e6-4d78-9b76-d12631cb55e2" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:53 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[677dfc46-2152-4803-9c0d-b8bf634554f6]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:54 devstack sudo[90492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2
Jul 07 22:33:54 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:54 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f7df3cbd-da70-43dc-95c2-a4cb9da960e8 tempest-GroupSnapshotsTest-93294595 None] Update group completed successfully.
Jul 07 22:33:55 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2" returned: 0 in 1.067s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:55 devstack sudo[90513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2
Jul 07 22:33:55 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:56 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-950159d5-c0e6-4d78-9b76-d12631cb55e2" returned: 0 in 0.977s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Lock "cinder-quobyte-950159d5-c0e6-4d78-9b76-d12631cb55e2" released by "delete_volume" :: held 2.111s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Created reservations ['50c0b216-e427-4525-9c23-e7ece239a4c9', '3e900477-d7bb-478b-969d-fbdae4dd522b', 'eb52eabe-b9f0-47eb-91f2-be6e61ae740c', '12c74ca3-471e-42b1-ab8b-c92955d12ca9'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:56 devstack sudo[90521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:33:56 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Acquiring lock "cinder-da47e910-5799-4c3b-98f8-60c17ddf96b2-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Lock "cinder-da47e910-5799-4c3b-98f8-60c17ddf96b2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Acquiring lock "cinder-quobyte-da47e910-5799-4c3b-98f8-60c17ddf96b2" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Lock "cinder-quobyte-da47e910-5799-4c3b-98f8-60c17ddf96b2" acquired by "delete_volume" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e36164b-525c-40bc-a992-40f31ea4e74e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:56 devstack sudo[90523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2
Jul 07 22:33:56 devstack sudo[90523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] GroupSnapshot 97d4f957-468d-40e1-b50e-520b2cb17097: creating.
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Group snapshot 97d4f957-468d-40e1-b50e-520b2cb17097: creating. {{(pid=88077) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Creating offline snapshot 18ce539b-482a-4bf8-a7d1-0eafcc376b54 of volume f27be0d3-5a46-4a22-a6ed-48da72df10ee {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3857b2-6838-45ec-93dc-0531b36df4c7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:33:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:56 devstack sudo[90525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee
Jul 07 22:33:56 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:57 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.849s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:57 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:33:57 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Deleted volume successfully.
Jul 07 22:33:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80210773-e5cc-4249-907c-bf05d43be581 tempest-VolumesTestJSON-928020857 None] Lock "cinder-950159d5-c0e6-4d78-9b76-d12631cb55e2-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:57 devstack sudo[90523]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2" returned: 0 in 0.900s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:57 devstack sudo[90532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2
Jul 07 22:33:57 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:57 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee" returned: 0 in 0.975s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:57 devstack sudo[90538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54 1G
Jul 07 22:33:57 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:58 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-da47e910-5799-4c3b-98f8-60c17ddf96b2" returned: 0 in 0.886s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Lock "cinder-quobyte-da47e910-5799-4c3b-98f8-60c17ddf96b2" released by "delete_volume" :: held 1.849s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Created reservations ['4b9c0c01-9cdb-47d5-a213-2acc4f6d54a8', '077a5600-2b1d-4837-9003-6abfa8ee4c2b', '2bd6a076-5f37-486a-ba23-d368555c66f5', 'ba295b43-81d8-4792-ba08-f8efa450ad93'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:58 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:33:58 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:58 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54 1G" returned: 0 in 1.069s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:58 devstack sudo[90547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54
Jul 07 22:33:58 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:59 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.957s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:59 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:33:59 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Deleted volume successfully.
Jul 07 22:33:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f37c7f2-0eaa-4aa9-920e-54ac849c2a0f tempest-TaggedAttachmentsTest-1830096924 None] Lock "cinder-da47e910-5799-4c3b-98f8-60c17ddf96b2-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:33:59 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54" returned: 0 in 1.225s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:59 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:33:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:59 devstack sudo[90555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54
Jul 07 22:33:59 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:00 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54" returned: 0 in 0.943s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:00 devstack sudo[90559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.info
Jul 07 22:34:00 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:01 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.info" returned: 0 in 0.814s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:01 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:34:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:01 devstack sudo[90563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.info
Jul 07 22:34:01 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:02 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.info" returned: 0 in 0.895s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.065s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Creating offline snapshot b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 of volume 0993d806-7ed5-443b-8118-6c2966d11246 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:34:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac217d2-b4bf-45e4-a6b5-423aa9fc6fab]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-10c5b245-ba2b-4aba-8c7c-ffd062336a7c tempest-BackendsCapabilitiesAdminTestsJSON-137143339 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7463302612305, 'free_capacity_gb': 1775.7463302612305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88077) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 07 22:34:02 devstack sudo[90569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246
Jul 07 22:34:02 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-75fc77bd-a659-44ce-9b89-c07395c60921 tempest-BackendsCapabilitiesAdminTestsJSON-137143339 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7463302612305, 'free_capacity_gb': 1775.7463302612305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88077) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 07 22:34:03 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246" returned: 0 in 1.112s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:03 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 1G
Jul 07 22:34:03 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:05 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 1G" returned: 0 in 1.395s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0993d806-7ed5-443b-8118-6c2966d11246 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:05 devstack sudo[90620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0993d806-7ed5-443b-8118-6c2966d11246 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4
Jul 07 22:34:05 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:06 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0993d806-7ed5-443b-8118-6c2966d11246 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4" returned: 0 in 0.933s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:06 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:34:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:06 devstack sudo[90626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4
Jul 07 22:34:06 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:07 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4" returned: 0 in 0.830s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:07 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.info
Jul 07 22:34:07 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:07 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.info" returned: 0 in 0.762s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:07 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:34:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:07 devstack sudo[90633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.info
Jul 07 22:34:07 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:08 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.info" returned: 0 in 0.845s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.024s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:08 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6f3e2403-057f-4d50-82b4-7f5e01305a17 tempest-GroupSnapshotsTest-93294595 None] group_snapshot 97d4f957-468d-40e1-b50e-520b2cb17097: created successfully
Jul 07 22:34:09 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] group_snapshot 97d4f957-468d-40e1-b50e-520b2cb17097: deleting
Jul 07 22:34:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] group_snapshot 97d4f957-468d-40e1-b50e-520b2cb17097: deleting {{(pid=88077) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 22:34:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-f27be0d3-5a46-4a22-a6ed-48da72df10ee" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-f27be0d3-5a46-4a22-a6ed-48da72df10ee" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-18ce539b-482a-4bf8-a7d1-0eafcc376b54" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-18ce539b-482a-4bf8-a7d1-0eafcc376b54" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Deleting offline snapshot 18ce539b-482a-4bf8-a7d1-0eafcc376b54 of volume f27be0d3-5a46-4a22-a6ed-48da72df10ee {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:34:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] snapshot_file for this snap is: volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:34:09 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b93c3ef-badf-4850-9829-858f8acb2686]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:10 devstack sudo[90639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54
Jul 07 22:34:10 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:11 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54" returned: 0 in 1.357s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:34:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aebdd6-1449-439c-a8c7-c3bc507a2aec]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:11 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee
Jul 07 22:34:11 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:12 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee" returned: 0 in 1.000s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:12 devstack sudo[90652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54
Jul 07 22:34:12 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:13 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54" returned: 0 in 1.201s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:13 devstack sudo[90659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54
Jul 07 22:34:13 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:14 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee.18ce539b-482a-4bf8-a7d1-0eafcc376b54" returned: 0 in 1.119s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-18ce539b-482a-4bf8-a7d1-0eafcc376b54" released by "_delete_snapshot" :: held 4.896s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-f27be0d3-5a46-4a22-a6ed-48da72df10ee" released by "delete_snapshot" :: held 4.925s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-0993d806-7ed5-443b-8118-6c2966d11246" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-0993d806-7ed5-443b-8118-6c2966d11246" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-b36f9a72-5b9a-434c-9d9e-f42018f0bcb4" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-b36f9a72-5b9a-434c-9d9e-f42018f0bcb4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Deleting offline snapshot b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 of volume 0993d806-7ed5-443b-8118-6c2966d11246 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] snapshot_file for this snap is: volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a441e3a4-dbeb-465d-aa84-1c34aa9bb83b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:14 devstack sudo[90662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4
Jul 07 22:34:14 devstack sudo[90662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:15 devstack sudo[90662]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4" returned: 0 in 0.972s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0993d806-7ed5-443b-8118-6c2966d11246(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:34:15 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb3983c-5e18-4b68-a896-4c4fc3cb12c7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:16 devstack sudo[90670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246
Jul 07 22:34:16 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:16 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246" returned: 0 in 1.098s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:16 devstack sudo[90675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4
Jul 07 22:34:16 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:17 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4" returned: 0 in 0.938s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:17 devstack sudo[90680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4
Jul 07 22:34:17 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:18 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246.b36f9a72-5b9a-434c-9d9e-f42018f0bcb4" returned: 0 in 0.920s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-b36f9a72-5b9a-434c-9d9e-f42018f0bcb4" released by "_delete_snapshot" :: held 4.157s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-0993d806-7ed5-443b-8118-6c2966d11246" released by "delete_snapshot" :: held 4.198s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:18 devstack cinder-volume[88077]: WARNING cinder.quota [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1325395933 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1325395933, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:34:18 devstack cinder-volume[88077]: WARNING cinder.quota [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1325395933 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1325395933, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:34:18 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['f2889a08-11cf-4540-a8e0-e167667cfdf1', '72ba25ac-f29e-4696-a683-bf0ccb6678c2', '35cbc190-9eff-41b7-85f1-740dd2fa865b', '8282ef90-9c1a-4bad-85f2-d5e4f9825590'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:19 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['7f424391-8a3b-46c0-a767-feb9b4add29e', '02a76a5a-8d6d-497b-a225-620ef34c6d71', 'e767e3c1-cc89-4b48-ad9c-83a813a0182c', 'f393cb48-bc26-4bbb-8bfc-5bd4d71cfc4d'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:19 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-aa1f595c-d47f-4a1e-9934-d47f4cc86e76 tempest-GroupSnapshotsTest-93294595 None] group_snapshot 97d4f957-468d-40e1-b50e-520b2cb17097: deleted successfully
Jul 07 22:34:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-0993d806-7ed5-443b-8118-6c2966d11246" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-0993d806-7ed5-443b-8118-6c2966d11246" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:20 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9183091d-67f8-49f4-9108-7686c0e2ee5a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:20 devstack sudo[90684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246
Jul 07 22:34:20 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:21 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246" returned: 0 in 1.138s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:21 devstack sudo[90690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246
Jul 07 22:34:21 devstack sudo[90690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:22 devstack sudo[90690]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0993d806-7ed5-443b-8118-6c2966d11246" returned: 0 in 1.074s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-0993d806-7ed5-443b-8118-6c2966d11246" released by "delete_volume" :: held 2.324s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-f27be0d3-5a46-4a22-a6ed-48da72df10ee" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-f27be0d3-5a46-4a22-a6ed-48da72df10ee" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b43a82-f0e8-4ef8-821f-c3a879c97c6c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:22 devstack sudo[90693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee
Jul 07 22:34:22 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=118,cinder:SELECT=98,cinder:INSERT=25,cinder:DELETE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=102,cinder:UPDATE=101,cinder:INSERT=25,cinder:DELETE=8 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Flow 'volume_create_manager' (4bc31a42-bfdb-4cbb-9e29-612d6862a632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7781d293-5b1c-48e6-a483-672a702aa15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7781d293-5b1c-48e6-a483-672a702aa15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1623209659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbfb68f-6116-4e09-a9b9-e8b3c99879bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4356592b27084c0e9af8ba34ee0ce18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:23Z,use_quota=True,user_id='51ab748fbedd4ba093f2a9b956a0be24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ab7fc37-68ce-432c-b0f1-790b535c9a2a),volume_type_id=0ab7fc37-68ce-432c-b0f1-790b535c9a2a)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61895c36-caac-410c-a4bb-aa62bc800f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61895c36-caac-410c-a4bb-aa62bc800f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269336f6-792b-4901-b841-7f9ae552486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (269336f6-792b-4901-b841-7f9ae552486a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbfb68f-6116-4e09-a9b9-e8b3c99879bf', 'volume_name': 'volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9593d09c-7827-42a1-b203-f2bc997e2b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9593d09c-7827-42a1-b203-f2bc997e2b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694e1e4e-a6f4-4f16-8b61-6bcbcc36584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:23 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Volume 2dbfb68f-6116-4e09-a9b9-e8b3c99879bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf', 'volume_size': 1}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:34:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1623209659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbfb68f-6116-4e09-a9b9-e8b3c99879bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4356592b27084c0e9af8ba34ee0ce18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:23Z,use_quota=True,user_id='51ab748fbedd4ba093f2a9b956a0be24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ab7fc37-68ce-432c-b0f1-790b535c9a2a),volume_type_id=0ab7fc37-68ce-432c-b0f1-790b535c9a2a)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Creating volume 2dbfb68f-6116-4e09-a9b9-e8b3c99879bf {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:34:23 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:23 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf 1073741824
Jul 07 22:34:23 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:23 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee" returned: 0 in 1.313s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:24 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee
Jul 07 22:34:24 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:24 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf 1073741824" returned: 0 in 1.435s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:24 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f27be0d3-5a46-4a22-a6ed-48da72df10ee" returned: 0 in 1.038s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:25 devstack sudo[90708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf
Jul 07 22:34:25 devstack sudo[90708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-f27be0d3-5a46-4a22-a6ed-48da72df10ee" released by "delete_volume" :: held 2.446s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['733fb956-7b43-4494-8352-c9572ec61c62'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:25 devstack cinder-volume[88077]: WARNING cinder.quota [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1325395933 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1325395933, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['397e086f-54f6-4f03-8283-c32213a17367', '997ce1e8-3e78-4259-ad45-edf3a67f653c', '5b67bb3d-9326-4313-b049-c7c8e55c1ce8', 'e255a9ae-d739-4496-873d-d0d7db30270d'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['0be87aa0-e6af-4f4d-9ba8-fe62d9a77f53', '727c84e5-fe8a-49e7-994e-0ce670a38b47', '8c4578dd-c614-48f3-9c7a-aa40b7502909', '60e0bb1b-9bc9-4ebc-9a79-3419c18bb80e'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:25 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:34:25 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:25 devstack sudo[90708]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf" returned: 0 in 0.982s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] <== create_volume: return (2498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.500s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694e1e4e-a6f4-4f16-8b61-6bcbcc36584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:25 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac674402-febb-4721-8217-c2c6e12f9ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:26 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Volume volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf (2dbfb68f-6116-4e09-a9b9-e8b3c99879bf): created successfully
Jul 07 22:34:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac674402-febb-4721-8217-c2c6e12f9ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Flow 'volume_create_manager' (4bc31a42-bfdb-4cbb-9e29-612d6862a632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:34:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-76b9bf05-7d28-4303-8b55-66c0533e870a tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Created volume successfully.
Jul 07 22:34:26 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.882s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:26 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:34:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e7d16467-3d70-4c51-ba13-dbe593087391 tempest-GroupSnapshotsTest-93294595 None] Delete group completed successfully.
Jul 07 22:34:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-27b9d0d8-d38d-4f26-8591-ad9236f1b271 tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-27b9d0d8-d38d-4f26-8591-ad9236f1b271 tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-27b9d0d8-d38d-4f26-8591-ad9236f1b271 tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-27b9d0d8-d38d-4f26-8591-ad9236f1b271 tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-27b9d0d8-d38d-4f26-8591-ad9236f1b271 tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-27b9d0d8-d38d-4f26-8591-ad9236f1b271 tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-752fce11-ad19-4e7e-a286-8a47ffb8eb3a tempest-GroupSnapshotsTest-93294595 None] Group tempest-GroupSnapshotsTest-Group-2000035302: creating
Jul 07 22:34:27 devstack sudo[90714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:34:27 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-752fce11-ad19-4e7e-a286-8a47ffb8eb3a tempest-GroupSnapshotsTest-93294595 None] Group tempest-GroupSnapshotsTest-Group-2000035302: created successfully
Jul 07 22:34:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-752fce11-ad19-4e7e-a286-8a47ffb8eb3a tempest-GroupSnapshotsTest-93294595 None] Create group completed successfully.
Jul 07 22:34:28 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-27b9d0d8-d38d-4f26-8591-ad9236f1b271 tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.764s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:28 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-27b9d0d8-d38d-4f26-8591-ad9236f1b271 tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:34:28 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-27b9d0d8-d38d-4f26-8591-ad9236f1b271 tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Retype volume completed successfully.
Jul 07 22:34:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Acquiring lock "cinder-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "cinder-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Acquiring lock "cinder-quobyte-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "cinder-quobyte-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf" acquired by "delete_volume" :: waited 0.041s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:28 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cc69df-56b8-4a6a-92d1-4381d0bae028]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:28 devstack sudo[90717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf
Jul 07 22:34:28 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Flow 'volume_create_manager' (8a25fc07-c50f-415e-ba6c-5b4a569c0098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba51333a-14de-46b8-93c7-c581daf40d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba51333a-14de-46b8-93c7-c581daf40d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-78905262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cd3e505b-a058-4391-880f-0510a7c55cf8,host='devstack@QuobyteHD#QuobyteHD',id=bcf025fb-6d1d-4f05-aef2-480de2d7d0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0330c16497d414793e80bd5de8b9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:29Z,use_quota=True,user_id='f8d80d3e29ff4888a9e178d228b1bb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b967f946-272a-404c-91c7-46671cf8c08d),volume_type_id=b967f946-272a-404c-91c7-46671cf8c08d)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8e82a0-97c7-4da2-a9a2-9ba184fe2a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d8e82a0-97c7-4da2-a9a2-9ba184fe2a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0842a9e7-6190-4a42-bf36-8cb350de806c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0842a9e7-6190-4a42-bf36-8cb350de806c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf025fb-6d1d-4f05-aef2-480de2d7d0ee', 'volume_name': 'volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d694893b-2b5c-429e-8a66-3b225f7e6c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d694893b-2b5c-429e-8a66-3b225f7e6c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7706f263-d3a0-47b2-8305-d82787404034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:29 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Volume bcf025fb-6d1d-4f05-aef2-480de2d7d0ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee', 'volume_size': 1}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cd3e505b-a058-4391-880f-0510a7c55cf8,created_at=2026-07-07T20:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-78905262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cd3e505b-a058-4391-880f-0510a7c55cf8,host='devstack@QuobyteHD#QuobyteHD',id=bcf025fb-6d1d-4f05-aef2-480de2d7d0ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0330c16497d414793e80bd5de8b9a1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:29Z,use_quota=True,user_id='f8d80d3e29ff4888a9e178d228b1bb56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b967f946-272a-404c-91c7-46671cf8c08d),volume_type_id=b967f946-272a-404c-91c7-46671cf8c08d)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Creating volume bcf025fb-6d1d-4f05-aef2-480de2d7d0ee {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:34:29 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:29 devstack sudo[90719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee 1073741824
Jul 07 22:34:29 devstack sudo[90719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:29 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf" returned: 0 in 1.112s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:29 devstack sudo[90725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf
Jul 07 22:34:29 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:30 devstack sudo[90719]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee 1073741824" returned: 0 in 1.166s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:30 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf" returned: 0 in 0.891s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:30 devstack sudo[90732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee
Jul 07 22:34:30 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "cinder-quobyte-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf" released by "delete_volume" :: held 2.102s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:30 devstack cinder-volume[88077]: WARNING cinder.quota [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:34:30 devstack cinder-volume[88077]: WARNING cinder.quota [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:34:30 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Created reservations ['7aebba91-77d6-46ef-8d78-520380da4ba1', '2fb4c713-627c-4a6f-9924-2da05676dece', '0b984480-9233-4315-95c0-34f4b1bb52df', 'a48e6240-6c8c-4883-a84c-381f6ee18047'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:31 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:34:31 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:32 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" returned: 0 in 1.331s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] <== create_volume: return (2601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:34:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.607s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7706f263-d3a0-47b2-8305-d82787404034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4903756d-4007-4668-86f4-2d149bca0157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:32 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Volume volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee (bcf025fb-6d1d-4f05-aef2-480de2d7d0ee): created successfully
Jul 07 22:34:32 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4903756d-4007-4668-86f4-2d149bca0157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Flow 'volume_create_manager' (8a25fc07-c50f-415e-ba6c-5b4a569c0098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:34:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.146s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:32 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:34:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Deleted volume successfully.
Jul 07 22:34:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e97d45e2-ee95-4851-8896-1455c205baed tempest-GroupSnapshotsTest-93294595 None] Created volume successfully.
Jul 07 22:34:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3ac713a-f796-4671-8d00-166389bad24e tempest-VolumeRetypeWithoutMigrationTest-1585441607 None] Lock "cinder-2dbfb68f-6116-4e09-a9b9-e8b3c99879bf-delete_volume" released by "delete_volume" :: held 3.695s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] GroupSnapshot fa962382-bb69-4fe5-a761-bb57a50a96da: creating.
Jul 07 22:34:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Group snapshot fa962382-bb69-4fe5-a761-bb57a50a96da: creating. {{(pid=88077) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 22:34:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Creating offline snapshot 1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 of volume bcf025fb-6d1d-4f05-aef2-480de2d7d0ee {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:34:33 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baac33a-a854-4b71-9afd-c3e1b534f285]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:34 devstack sudo[90738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee
Jul 07 22:34:34 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:35 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" returned: 0 in 1.189s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:35 devstack sudo[90747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 1G
Jul 07 22:34:35 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:36 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 1G" returned: 0 in 1.163s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:36 devstack sudo[90756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0
Jul 07 22:34:36 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:37 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0" returned: 0 in 0.906s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:37 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:34:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:37 devstack sudo[90766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0
Jul 07 22:34:37 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:37 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0" returned: 0 in 0.821s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:38 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.info
Jul 07 22:34:38 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:38 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.info" returned: 0 in 0.744s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:38 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:34:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:38 devstack sudo[90774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.info
Jul 07 22:34:38 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:39 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.info" returned: 0 in 0.726s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.698s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:39 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-7de2bb10-5685-4f9a-9e35-fe647074033d tempest-GroupSnapshotsTest-93294595 None] group_snapshot fa962382-bb69-4fe5-a761-bb57a50a96da: created successfully
Jul 07 22:34:40 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] group_snapshot fa962382-bb69-4fe5-a761-bb57a50a96da: deleting
Jul 07 22:34:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] group_snapshot fa962382-bb69-4fe5-a761-bb57a50a96da: deleting {{(pid=88077) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 22:34:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Deleting offline snapshot 1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 of volume bcf025fb-6d1d-4f05-aef2-480de2d7d0ee {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:34:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] snapshot_file for this snap is: volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:34:40 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4033f09d-b056-495c-bbc7-69316b3c5491]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:40 devstack sudo[90779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0
Jul 07 22:34:40 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:41 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0" returned: 0 in 1.069s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:34:41 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddd229d-a4cf-4605-a66c-e428d5a95933]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:41 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee
Jul 07 22:34:41 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:42 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" returned: 0 in 1.198s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:42 devstack sudo[90812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0
Jul 07 22:34:42 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:34:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:43 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:34:43 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:43 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0" returned: 0 in 1.051s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:43 devstack sudo[90821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0
Jul 07 22:34:43 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:44 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.091s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:34:45 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee.1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0" returned: 0 in 1.171s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-1f5f53a4-6ebc-4c8b-b60f-0b5a99b052d0" released by "_delete_snapshot" :: held 4.662s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" released by "delete_snapshot" :: held 4.716s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:45 devstack cinder-volume[88077]: WARNING cinder.quota [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-707588748 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-707588748, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:34:45 devstack cinder-volume[88077]: WARNING cinder.quota [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-707588748 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-707588748, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:34:45 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['1916839e-e03b-436a-9ed5-f66286b41e3c', 'eb319706-7f46-404f-b166-fb2dd0226365', '20f98bba-d44a-4f72-b270-ca67163ce12c', '23924526-cc18-47b0-89d8-0b20a3fe9608'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:45 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-38df3c3b-d30b-4b30-89ea-ceefd9b3d691 tempest-GroupSnapshotsTest-93294595 None] group_snapshot fa962382-bb69-4fe5-a761-bb57a50a96da: deleted successfully
Jul 07 22:34:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "cinder-quobyte-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:46 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d151866c-ac97-4844-9782-f343820025d1]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:46 devstack sudo[90842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee
Jul 07 22:34:46 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:47 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" returned: 0 in 0.965s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:47 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee
Jul 07 22:34:47 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:48 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" returned: 0 in 1.310s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Lock "cinder-quobyte-bcf025fb-6d1d-4f05-aef2-480de2d7d0ee" released by "delete_volume" :: held 2.400s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:49 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['b3f47428-a8af-4d9d-bf02-9ac2d7f6bb1b'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:49 devstack cinder-volume[88077]: WARNING cinder.quota [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-707588748 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-707588748, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:34:49 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Created reservations ['3200f5f8-d926-4686-8e42-44dfec7aeabb', 'cb31d27d-0332-41dd-9dcb-b5489480a146', 'dac43bea-32c0-420a-b8be-dce242fd21a5', 'a86362c8-02b2-4f6d-aaba-a6ce3eca43b4'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:49 devstack sudo[90897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:34:49 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Flow 'volume_create_manager' (f712f20b-566a-4745-8c64-494bb5481d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2c99d4-0380-426a-a041-b516021d08df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2c99d4-0380-426a-a041-b516021d08df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2037618415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbc8256211045a0818404829e215a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:50Z,use_quota=True,user_id='f519aed3908645b694a0a9a7b0c3fce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2bd651-602b-442c-96f0-8cfeb0345e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2bd651-602b-442c-96f0-8cfeb0345e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bcd17ab-7505-4c11-b9f8-bbc48c97f273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bcd17ab-7505-4c11-b9f8-bbc48c97f273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da', 'volume_name': 'volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8400116-3ec1-426b-807e-2381a4e7c3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8400116-3ec1-426b-807e-2381a4e7c3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c239bbea-4ad3-4a24-bc06-24d035dbf179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:50 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Volume e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da', 'volume_size': 1}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:50 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2037618415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fbc8256211045a0818404829e215a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:50Z,use_quota=True,user_id='f519aed3908645b694a0a9a7b0c3fce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Creating volume e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:34:50 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.944s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:50 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:34:50 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-91ef5cc9-d4df-4bda-a0d8-15d6fbb89d38 tempest-GroupSnapshotsTest-93294595 None] Delete group completed successfully.
Jul 07 22:34:50 devstack sudo[90920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da 1073741824
Jul 07 22:34:50 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:52 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da 1073741824" returned: 0 in 1.987s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:52 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da
Jul 07 22:34:52 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:53 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da" returned: 0 in 1.166s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] <== create_volume: return (3241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:34:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.244s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c239bbea-4ad3-4a24-bc06-24d035dbf179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9dff25-dc71-4c2f-807e-c58f4a2b8045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:53 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Volume volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da (e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da): created successfully
Jul 07 22:34:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9dff25-dc71-4c2f-807e-c58f4a2b8045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Flow 'volume_create_manager' (f712f20b-566a-4745-8c64-494bb5481d07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:34:53 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a7b64111-4119-44c4-8e15-4311bc342c81 tempest-AbsoluteLimitsTests-1306288816 None] Created volume successfully.
Jul 07 22:34:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Acquiring lock "cinder-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Lock "cinder-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Acquiring lock "cinder-quobyte-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Lock "cinder-quobyte-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da" acquired by "delete_volume" :: waited 0.048s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[378b7c7f-02f9-4b36-ad65-16b71309d59b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:55 devstack sudo[91000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da
Jul 07 22:34:55 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:57 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da" returned: 0 in 1.739s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:57 devstack sudo[91007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da
Jul 07 22:34:57 devstack sudo[91007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Flow 'volume_create_manager' (6d2d8ed5-4798-4512-8dc9-2169207d8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f02101-eec6-4623-9c9e-95488feca878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f02101-eec6-4623-9c9e-95488feca878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-636454879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ef2698-96c5-438d-8f47-ea383e661040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74a9680b1e34c21afcac029e7772981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:58Z,use_quota=True,user_id='56d61e209bec4c0bb20a2b6c077c0b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f37853-b041-4aad-9876-600b5881561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f37853-b041-4aad-9876-600b5881561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6724a57e-f765-4976-a666-76a95a1c58fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6724a57e-f765-4976-a666-76a95a1c58fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ef2698-96c5-438d-8f47-ea383e661040', 'volume_name': 'volume-49ef2698-96c5-438d-8f47-ea383e661040', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2776392-122e-465a-b6d0-92bf06267aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2776392-122e-465a-b6d0-92bf06267aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42869820-5a90-4d97-9759-6483b6567b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:58 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Volume 49ef2698-96c5-438d-8f47-ea383e661040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ef2698-96c5-438d-8f47-ea383e661040', 'volume_size': 1}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-636454879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ef2698-96c5-438d-8f47-ea383e661040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f74a9680b1e34c21afcac029e7772981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:58Z,use_quota=True,user_id='56d61e209bec4c0bb20a2b6c077c0b1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Creating volume 49ef2698-96c5-438d-8f47-ea383e661040 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:34:58 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:58 devstack sudo[91009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040 1073741824
Jul 07 22:34:58 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:58 devstack sudo[91007]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da" returned: 0 in 1.595s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Lock "cinder-quobyte-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da" released by "delete_volume" :: held 3.533s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:59 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Created reservations ['d71d8c90-26f8-4aa7-83be-dad4cbc3354c', '7ad443b5-2186-46ce-91b0-36cd4bc30fbe', '9101e011-a560-4b87-ae6f-23bfdce6d28e', 'bcdf7015-f44d-4689-9829-2a06ceb23e5a'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:59 devstack sudo[91014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:34:59 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:59 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040 1073741824" returned: 0 in 1.508s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:59 devstack sudo[91018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040
Jul 07 22:34:59 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:00 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.325s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:00 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:35:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Deleted volume successfully.
Jul 07 22:35:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-56d1e5f9-8c65-4e44-901d-69879dfb7f44 tempest-AbsoluteLimitsTests-1306288816 None] Lock "cinder-e3f95fc8-f6d1-45cd-974d-95e9bdd4c9da-delete_volume" released by "delete_volume" :: held 5.336s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:01 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040" returned: 0 in 1.696s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] <== create_volume: return (3322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.328s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42869820-5a90-4d97-9759-6483b6567b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ef2698-96c5-438d-8f47-ea383e661040', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4aef688-8eba-4494-b7cc-83a1b77c4ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:01 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Volume volume-49ef2698-96c5-438d-8f47-ea383e661040 (49ef2698-96c5-438d-8f47-ea383e661040): created successfully
Jul 07 22:35:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4aef688-8eba-4494-b7cc-83a1b77c4ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Flow 'volume_create_manager' (6d2d8ed5-4798-4512-8dc9-2169207d8643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-35e26690-7ac6-499b-af77-ba92f9a7b2b7 tempest-DeleteServersTestJSON-676597984 None] Created volume successfully.
Jul 07 22:35:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-913ac44b-6856-4665-b5e9-9be52aae5792 req-6244c38f-ae40-49fb-b284-0a2c2dfbbe58 tempest-DeleteServersTestJSON-676597984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-913ac44b-6856-4665-b5e9-9be52aae5792 req-6244c38f-ae40-49fb-b284-0a2c2dfbbe58 tempest-DeleteServersTestJSON-676597984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:07 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fcd5e7-3cc0-4573-89a8-d5c4848f2bb5]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-913ac44b-6856-4665-b5e9-9be52aae5792 req-6244c38f-ae40-49fb-b284-0a2c2dfbbe58 tempest-DeleteServersTestJSON-676597984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:08 devstack sudo[91138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040
Jul 07 22:35:08 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:09 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-913ac44b-6856-4665-b5e9-9be52aae5792 req-6244c38f-ae40-49fb-b284-0a2c2dfbbe58 tempest-DeleteServersTestJSON-676597984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040" returned: 0 in 1.405s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-913ac44b-6856-4665-b5e9-9be52aae5792 req-6244c38f-ae40-49fb-b284-0a2c2dfbbe58 tempest-DeleteServersTestJSON-676597984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.439s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-913ac44b-6856-4665-b5e9-9be52aae5792 req-6244c38f-ae40-49fb-b284-0a2c2dfbbe58 tempest-DeleteServersTestJSON-676597984 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-49ef2698-96c5-438d-8f47-ea383e661040', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd86a97fb-14d3-4c87-93bf-588a01ce7269', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:35:09 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-913ac44b-6856-4665-b5e9-9be52aae5792 req-6244c38f-ae40-49fb-b284-0a2c2dfbbe58 tempest-DeleteServersTestJSON-676597984 None] attachment_update completed successfully.
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Flow 'volume_create_manager' (8492b973-3872-40cd-a85e-566ab9c1a4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d701687-4239-471e-a008-4fd00a6ad6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d701687-4239-471e-a008-4fd00a6ad6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-474609526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad57e730-bca1-4c3a-aa22-000d5e529b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfadd5fad5d74788b44cf23b086b172c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:13Z,use_quota=True,user_id='02b1cc4b9dce43f485c3675970f860b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee5cada-145f-4bbb-a537-5f3796f7e88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee5cada-145f-4bbb-a537-5f3796f7e88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d3032a-0117-410a-9f73-c751ba84fe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d3032a-0117-410a-9f73-c751ba84fe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad57e730-bca1-4c3a-aa22-000d5e529b68', 'volume_name': 'volume-ad57e730-bca1-4c3a-aa22-000d5e529b68', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283d61f0-8066-485f-920f-1ed119e169bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (283d61f0-8066-485f-920f-1ed119e169bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966dcb65-6e6b-48b7-8f14-01a81bee4262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:13 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Volume ad57e730-bca1-4c3a-aa22-000d5e529b68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad57e730-bca1-4c3a-aa22-000d5e529b68', 'volume_size': 1}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-474609526',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad57e730-bca1-4c3a-aa22-000d5e529b68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfadd5fad5d74788b44cf23b086b172c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:13Z,use_quota=True,user_id='02b1cc4b9dce43f485c3675970f860b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Creating volume ad57e730-bca1-4c3a-aa22-000d5e529b68 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:35:13 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:35:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:13 devstack sudo[91588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68 1073741824
Jul 07 22:35:13 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:14 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68 1073741824" returned: 0 in 1.475s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:14 devstack sudo[91594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68
Jul 07 22:35:14 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:16 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68" returned: 0 in 1.222s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] <== create_volume: return (2814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.826s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (966dcb65-6e6b-48b7-8f14-01a81bee4262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad57e730-bca1-4c3a-aa22-000d5e529b68', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d696cba0-8ac3-46b7-b1bc-ce7c36a083fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:16 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Volume volume-ad57e730-bca1-4c3a-aa22-000d5e529b68 (ad57e730-bca1-4c3a-aa22-000d5e529b68): created successfully
Jul 07 22:35:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d696cba0-8ac3-46b7-b1bc-ce7c36a083fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Flow 'volume_create_manager' (8492b973-3872-40cd-a85e-566ab9c1a4cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6577f339-8de6-471d-9c35-4039178f3bb5 tempest-VolumesTransfersTest-519961761 None] Created volume successfully.
Jul 07 22:35:18 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b89c163e-df86-4224-ba52-e3470581a7ab tempest-VolumesTransfersTest-685357961 None] Transfer volume completed successfully.
Jul 07 22:35:19 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-abf86d8d-cd8f-4095-ad8f-6f12728f0ea3 req-55a1177c-4cfc-469c-89b5-bf9e96b0b4f4 tempest-DeleteServersTestJSON-676597984 None] Terminate volume connection completed successfully.
Jul 07 22:35:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-abf86d8d-cd8f-4095-ad8f-6f12728f0ea3 req-55a1177c-4cfc-469c-89b5-bf9e96b0b4f4 tempest-DeleteServersTestJSON-676597984 None] Deleting attachment d86a97fb-14d3-4c87-93bf-588a01ce7269. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:35:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Acquiring lock "cinder-ad57e730-bca1-4c3a-aa22-000d5e529b68-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Lock "cinder-ad57e730-bca1-4c3a-aa22-000d5e529b68-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Acquiring lock "cinder-quobyte-ad57e730-bca1-4c3a-aa22-000d5e529b68" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Lock "cinder-quobyte-ad57e730-bca1-4c3a-aa22-000d5e529b68" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e327e6cb-7514-4054-ae21-aa50d02dd6bf]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:19 devstack sudo[91677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68
Jul 07 22:35:19 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:20 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68" returned: 0 in 0.937s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:20 devstack sudo[91683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68
Jul 07 22:35:20 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:21 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ad57e730-bca1-4c3a-aa22-000d5e529b68" returned: 0 in 0.754s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Lock "cinder-quobyte-ad57e730-bca1-4c3a-aa22-000d5e529b68" released by "delete_volume" :: held 1.734s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:21 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Created reservations ['2f12d58b-f428-49b9-b8ca-3e4111674808', 'fed97124-40e2-4f46-ac4f-0d350fe99da3', '67abbd87-9b5a-4624-8170-8bcc6d2c5acb', 'b59615b6-1e61-45ca-ac8a-2f607a4e463e'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:35:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:21 devstack sudo[91686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:35:21 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:22 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.068s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:35:22 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Deleted volume successfully.
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f018da56-0d71-4054-ade5-d95b7734b35b tempest-VolumesTransfersTest-2146668579 None] Lock "cinder-ad57e730-bca1-4c3a-aa22-000d5e529b68-delete_volume" released by "delete_volume" :: held 3.044s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Flow 'volume_create_manager' (1543f40d-c7a8-4915-a1c5-968f643e72a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b449054-f8fd-410b-9c0a-f50be55ca1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b449054-f8fd-410b-9c0a-f50be55ca1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1286926459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93390ecf-de9e-43d4-87d5-5d14f4e243cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfadd5fad5d74788b44cf23b086b172c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:23Z,use_quota=True,user_id='02b1cc4b9dce43f485c3675970f860b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d855f0-31d3-4fe0-ba25-62328df42dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9d855f0-31d3-4fe0-ba25-62328df42dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36bb197d-85b3-4c2a-8cb8-302e35d7f701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36bb197d-85b3-4c2a-8cb8-302e35d7f701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93390ecf-de9e-43d4-87d5-5d14f4e243cc', 'volume_name': 'volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b2f17a-8943-49ab-86d9-cf8fea59569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b2f17a-8943-49ab-86d9-cf8fea59569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d8b148-e03e-483e-a10b-97b3cfd5cf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:22 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Volume 93390ecf-de9e-43d4-87d5-5d14f4e243cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc', 'volume_size': 1}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1286926459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93390ecf-de9e-43d4-87d5-5d14f4e243cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfadd5fad5d74788b44cf23b086b172c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:23Z,use_quota=True,user_id='02b1cc4b9dce43f485c3675970f860b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Creating volume 93390ecf-de9e-43d4-87d5-5d14f4e243cc {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:35:22 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:35:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:22 devstack sudo[91689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc 1073741824
Jul 07 22:35:22 devstack sudo[91689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Flow 'volume_create_manager' (8095d407-10d2-49d1-9da2-fbb7507ef191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1583f950-f31b-49b8-b2d8-09cc42da26c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1583f950-f31b-49b8-b2d8-09cc42da26c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1215611462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d8af84-1959-4629-87de-3e8b1336b2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d3f9331bb84cbb88275ca72721f390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:23Z,use_quota=True,user_id='e4d96754a71242268be22fe5e53c27f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de1fd3c-a24a-4854-9761-b229f019784f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9de1fd3c-a24a-4854-9761-b229f019784f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c9e398-e462-4cda-a313-343b1a6e3692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c9e398-e462-4cda-a313-343b1a6e3692) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42d8af84-1959-4629-87de-3e8b1336b2e9', 'volume_name': 'volume-42d8af84-1959-4629-87de-3e8b1336b2e9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854b1719-e061-44c8-b55b-039d3a83c898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (854b1719-e061-44c8-b55b-039d3a83c898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0876292c-d657-4678-8c5d-a5d865d8eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:23 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Volume 42d8af84-1959-4629-87de-3e8b1336b2e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42d8af84-1959-4629-87de-3e8b1336b2e9', 'volume_size': 1}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:23 devstack sudo[91689]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc 1073741824" returned: 0 in 0.968s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=70,cinder:UPDATE=82,cinder:INSERT=21,cinder:DELETE=5 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:INSERT=15,cinder:UPDATE=88,cinder:SELECT=82,cinder:DELETE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:35:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:23 devstack sudo[91696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc
Jul 07 22:35:23 devstack sudo[91696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Acquiring lock "cinder-49ef2698-96c5-438d-8f47-ea383e661040-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Lock "cinder-49ef2698-96c5-438d-8f47-ea383e661040-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Acquiring lock "cinder-quobyte-49ef2698-96c5-438d-8f47-ea383e661040" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Lock "cinder-quobyte-49ef2698-96c5-438d-8f47-ea383e661040" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb012448-ceb4-4ca6-876f-1fe563e5d3eb]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:24 devstack sudo[91696]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc" returned: 0 in 0.719s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.087s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1215611462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d8af84-1959-4629-87de-3e8b1336b2e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d3f9331bb84cbb88275ca72721f390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:23Z,use_quota=True,user_id='e4d96754a71242268be22fe5e53c27f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Creating volume 42d8af84-1959-4629-87de-3e8b1336b2e9 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:24 devstack sudo[91699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040
Jul 07 22:35:24 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:35:24 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:24 devstack sudo[91701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9 1073741824
Jul 07 22:35:24 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d8b148-e03e-483e-a10b-97b3cfd5cf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7f31e5-c244-46ef-b0ca-37f025896c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:24 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Volume volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc (93390ecf-de9e-43d4-87d5-5d14f4e243cc): created successfully
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7f31e5-c244-46ef-b0ca-37f025896c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Flow 'volume_create_manager' (1543f40d-c7a8-4915-a1c5-968f643e72a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:24 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-34c40404-3a38-44ee-b295-f6f55a36f401 tempest-VolumesTransfersTest-519961761 None] Created volume successfully.
Jul 07 22:35:25 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040" returned: 0 in 0.845s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:25 devstack sudo[91710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040
Jul 07 22:35:25 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:25 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9 1073741824" returned: 0 in 1.029s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:25 devstack sudo[91713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9
Jul 07 22:35:25 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:26 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-49ef2698-96c5-438d-8f47-ea383e661040" returned: 0 in 0.787s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Lock "cinder-quobyte-49ef2698-96c5-438d-8f47-ea383e661040" released by "delete_volume" :: held 1.676s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Created reservations ['81070082-51bf-452b-a8bb-5d24f6fd5472', 'df84083b-413a-484f-a244-bcc95d2eff50', '93b0ea9d-4551-4f77-91c5-fe48eba5abea', '6b53ca55-79df-4968-9871-36c3728efe50'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Acquiring lock "cinder-93390ecf-de9e-43d4-87d5-5d14f4e243cc-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Lock "cinder-93390ecf-de9e-43d4-87d5-5d14f4e243cc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:26 devstack sudo[91716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:35:26 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Acquiring lock "cinder-quobyte-93390ecf-de9e-43d4-87d5-5d14f4e243cc" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Lock "cinder-quobyte-93390ecf-de9e-43d4-87d5-5d14f4e243cc" acquired by "delete_volume" :: waited 0.033s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23c55fd-9249-48d5-a86a-d2f8e3b6074b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:26 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9" returned: 0 in 0.888s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0876292c-d657-4678-8c5d-a5d865d8eed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d8af84-1959-4629-87de-3e8b1336b2e9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d822a6b-8f6f-434d-93ee-153cddad964c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:26 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Volume volume-42d8af84-1959-4629-87de-3e8b1336b2e9 (42d8af84-1959-4629-87de-3e8b1336b2e9): created successfully
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d822a6b-8f6f-434d-93ee-153cddad964c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Flow 'volume_create_manager' (8095d407-10d2-49d1-9da2-fbb7507ef191) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-324bc111-7d39-48c3-b840-790a826c028f tempest-ServersNegativeTestJSON-1623813171 None] Created volume successfully.
Jul 07 22:35:26 devstack sudo[91719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc
Jul 07 22:35:26 devstack sudo[91719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:27 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.847s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:27 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:35:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Deleted volume successfully.
Jul 07 22:35:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f3324c1-511f-4b46-9302-7e1356086ee7 tempest-DeleteServersTestJSON-676597984 None] Lock "cinder-49ef2698-96c5-438d-8f47-ea383e661040-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:27 devstack sudo[91719]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc" returned: 0 in 1.026s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:27 devstack sudo[91725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc
Jul 07 22:35:27 devstack sudo[91725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:28 devstack sudo[91725]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-93390ecf-de9e-43d4-87d5-5d14f4e243cc" returned: 0 in 0.836s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Lock "cinder-quobyte-93390ecf-de9e-43d4-87d5-5d14f4e243cc" released by "delete_volume" :: held 1.946s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:28 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Created reservations ['f7c6fedc-e87e-47c8-a5b3-3787917e977c', '64a8f813-82e5-49ac-8814-08185b237718', '40ed07d9-902c-46b4-afbe-c2cd644df244', '2a40a991-019d-4125-86fc-1e41a591d7a0'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:35:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:28 devstack sudo[91728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:35:28 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:29 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.885s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:29 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:35:29 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Deleted volume successfully.
Jul 07 22:35:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94aac5d5-8352-4558-8152-c7b1869306e8 tempest-VolumesTransfersTest-2146668579 None] Lock "cinder-93390ecf-de9e-43d4-87d5-5d14f4e243cc-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:29 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:35:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Flow 'volume_create_manager' (a1371772-233a-47e1-aac2-4acf5eae417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845e3450-23bc-4862-a449-8a92f21db888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845e3450-23bc-4862-a449-8a92f21db888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-396933794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19934a07-2e1b-4068-8225-f2e6c18667b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d3f9331bb84cbb88275ca72721f390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:30Z,use_quota=True,user_id='e4d96754a71242268be22fe5e53c27f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c8ecd7-1c1b-42ed-bda4-d778e67f553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72c8ecd7-1c1b-42ed-bda4-d778e67f553e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7824d0df-d6d3-47a5-ac3d-c1f823a146d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7824d0df-d6d3-47a5-ac3d-c1f823a146d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19934a07-2e1b-4068-8225-f2e6c18667b3', 'volume_name': 'volume-19934a07-2e1b-4068-8225-f2e6c18667b3', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813c40ae-1198-49d3-8b2f-d308fb9dc3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813c40ae-1198-49d3-8b2f-d308fb9dc3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa67c75-5c67-41e2-8043-255ed9efd176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:30 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Volume 19934a07-2e1b-4068-8225-f2e6c18667b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19934a07-2e1b-4068-8225-f2e6c18667b3', 'volume_size': 1}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-396933794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19934a07-2e1b-4068-8225-f2e6c18667b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d3f9331bb84cbb88275ca72721f390',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:30Z,use_quota=True,user_id='e4d96754a71242268be22fe5e53c27f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Creating volume 19934a07-2e1b-4068-8225-f2e6c18667b3 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:35:30 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:35:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:30 devstack sudo[91733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3 1073741824
Jul 07 22:35:30 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:31 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3 1073741824" returned: 0 in 1.285s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:31 devstack sudo[91739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3
Jul 07 22:35:31 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:32 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3" returned: 0 in 1.009s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] <== create_volume: return (2353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffa67c75-5c67-41e2-8043-255ed9efd176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19934a07-2e1b-4068-8225-f2e6c18667b3', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d1958a-e7a7-4fd6-ac3d-3c14f99e9df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:32 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Volume volume-19934a07-2e1b-4068-8225-f2e6c18667b3 (19934a07-2e1b-4068-8225-f2e6c18667b3): created successfully
Jul 07 22:35:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d1958a-e7a7-4fd6-ac3d-3c14f99e9df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Flow 'volume_create_manager' (a1371772-233a-47e1-aac2-4acf5eae417c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6b6c5dd2-8d12-47dc-b435-c0e8677ca1d9 tempest-ServersNegativeTestJSON-1623813171 None] Created volume successfully.
Jul 07 22:35:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Acquiring lock "cinder-19934a07-2e1b-4068-8225-f2e6c18667b3-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Lock "cinder-19934a07-2e1b-4068-8225-f2e6c18667b3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Acquiring lock "cinder-quobyte-19934a07-2e1b-4068-8225-f2e6c18667b3" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Lock "cinder-quobyte-19934a07-2e1b-4068-8225-f2e6c18667b3" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:34 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99dca14-4860-4202-9390-8d510d402e98]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:34 devstack sudo[91743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3
Jul 07 22:35:34 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:35 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3" returned: 0 in 1.029s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:35 devstack sudo[91748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3
Jul 07 22:35:35 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:36 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-19934a07-2e1b-4068-8225-f2e6c18667b3" returned: 0 in 0.939s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Lock "cinder-quobyte-19934a07-2e1b-4068-8225-f2e6c18667b3" released by "delete_volume" :: held 2.042s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Flow 'volume_create_manager' (a9620f57-0984-4e7d-9ab9-ff8d863e165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ea10e2-eef8-4f90-baf0-c87afb9c2a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Created reservations ['dea44562-35cd-4d36-a6e3-a0843737d316', '31980769-7958-4a48-8a45-56bfb3f9f91c', '56ef8082-7fc2-417c-b5db-a48ce47a547c', '72c97ea0-e463-409f-9c3c-58665f44333b'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1ea10e2-eef8-4f90-baf0-c87afb9c2a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-466001315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c90645-5684-43ba-95c8-ee508afc3441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0614fa4f75054e3da57acb4d1e1e239e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:36Z,use_quota=True,user_id='2df2431aa9ae403a898c53700beefea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357d8e61-0330-41ad-9c5d-e2b183b5292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (357d8e61-0330-41ad-9c5d-e2b183b5292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaca8ee-cf71-4c12-8333-4041e84b25eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffaca8ee-cf71-4c12-8333-4041e84b25eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c90645-5684-43ba-95c8-ee508afc3441', 'volume_name': 'volume-73c90645-5684-43ba-95c8-ee508afc3441', 'volume_size': 2}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b151006-5838-4814-9c59-01ebd447a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b151006-5838-4814-9c59-01ebd447a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0301688e-a09a-4b4c-90ec-54aa79b87841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:36 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Volume 73c90645-5684-43ba-95c8-ee508afc3441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c90645-5684-43ba-95c8-ee508afc3441', 'volume_size': 2}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-466001315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c90645-5684-43ba-95c8-ee508afc3441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0614fa4f75054e3da57acb4d1e1e239e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:36Z,use_quota=True,user_id='2df2431aa9ae403a898c53700beefea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Creating volume 73c90645-5684-43ba-95c8-ee508afc3441 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:35:36 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441 2147483648 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:36 devstack sudo[91751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441 2147483648
Jul 07 22:35:36 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:36 devstack sudo[91753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:35:36 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:37 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.012s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:35:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Deleted volume successfully.
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Acquiring lock "cinder-42d8af84-1959-4629-87de-3e8b1336b2e9-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Lock "cinder-42d8af84-1959-4629-87de-3e8b1336b2e9-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b0f22dec-8588-40fe-a67e-0d08020079f2 tempest-ServersNegativeTestJSON-1623813171 None] Lock "cinder-19934a07-2e1b-4068-8225-f2e6c18667b3-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Acquiring lock "cinder-quobyte-42d8af84-1959-4629-87de-3e8b1336b2e9" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Lock "cinder-quobyte-42d8af84-1959-4629-87de-3e8b1336b2e9" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9029f-7a16-49d7-a347-4c09d2fa4038]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:37 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441 2147483648" returned: 0 in 1.427s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:37 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441
Jul 07 22:35:37 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:37 devstack sudo[91760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9
Jul 07 22:35:37 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:38 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9" returned: 0 in 1.000s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:38 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441" returned: 0 in 0.907s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] <== create_volume: return (2389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.394s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:38 devstack sudo[91768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9
Jul 07 22:35:38 devstack sudo[91768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0301688e-a09a-4b4c-90ec-54aa79b87841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c90645-5684-43ba-95c8-ee508afc3441', 'volume_size': 2}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7a5e42-6f6f-4c32-8703-c4473d6bb4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:38 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Volume volume-73c90645-5684-43ba-95c8-ee508afc3441 (73c90645-5684-43ba-95c8-ee508afc3441): created successfully
Jul 07 22:35:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7a5e42-6f6f-4c32-8703-c4473d6bb4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Flow 'volume_create_manager' (a9620f57-0984-4e7d-9ab9-ff8d863e165d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:38 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-15ca4bd0-1126-40d6-b78d-8272e74e58f9 tempest-VolumesCloneNegativeTest-861089836 None] Created volume successfully.
Jul 07 22:35:39 devstack sudo[91768]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42d8af84-1959-4629-87de-3e8b1336b2e9" returned: 0 in 0.765s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Lock "cinder-quobyte-42d8af84-1959-4629-87de-3e8b1336b2e9" released by "delete_volume" :: held 1.838s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Created reservations ['83407d75-4625-4a2a-aa24-0ded08d5628a', '0ec21096-b622-4e3a-a654-bf0bf0edfc11', '3debca81-78d7-4b20-b07c-1736d4691f61', '98e96e2c-c3e5-4f2f-90f7-548001bf0884'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Acquiring lock "cinder-73c90645-5684-43ba-95c8-ee508afc3441-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Lock "cinder-73c90645-5684-43ba-95c8-ee508afc3441-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Acquiring lock "cinder-quobyte-73c90645-5684-43ba-95c8-ee508afc3441" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:39 devstack sudo[91772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:35:39 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Lock "cinder-quobyte-73c90645-5684-43ba-95c8-ee508afc3441" acquired by "delete_volume" :: waited 0.042s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f006684-b0a6-4e8b-a404-a61c753a61e9]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:40 devstack sudo[91774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441
Jul 07 22:35:40 devstack sudo[91774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:40 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.995s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:40 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:35:40 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Deleted volume successfully.
Jul 07 22:35:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d6aec677-6876-47e7-b344-8eba30e1cccc tempest-ServersNegativeTestJSON-1623813171 None] Lock "cinder-42d8af84-1959-4629-87de-3e8b1336b2e9-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:41 devstack sudo[91774]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441" returned: 0 in 1.258s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:41 devstack sudo[91781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441
Jul 07 22:35:41 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:42 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-73c90645-5684-43ba-95c8-ee508afc3441" returned: 0 in 1.042s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Lock "cinder-quobyte-73c90645-5684-43ba-95c8-ee508afc3441" released by "delete_volume" :: held 2.420s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:42 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Created reservations ['99cd7cd9-e00d-4ba2-ae07-e2ebe8cc85f7', '29de15e9-867c-4ec3-95a2-ffdc0e4e67b6', 'e2f8d0b1-f9f8-4d9d-94ed-0b4cca6f97f6', '5c973d8d-33ff-4edf-ad38-c73d6d18a9ec'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:35:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:42 devstack sudo[91806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:35:42 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:43 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.893s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:43 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:35:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Deleted volume successfully.
Jul 07 22:35:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-41c3b1db-f7b5-4252-96ea-42ed1965d7b9 tempest-VolumesCloneNegativeTest-861089836 None] Lock "cinder-73c90645-5684-43ba-95c8-ee508afc3441-delete_volume" released by "delete_volume" :: held 3.722s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:35:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:43 devstack sudo[91815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:35:43 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:44 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.833s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:35:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:35:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 8 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:35:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (bdf3c512-598a-484c-9895-60cea0703bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29087cdc-131f-44ab-b4c7-1f958d40f0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29087cdc-131f-44ab-b4c7-1f958d40f0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1737936862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42260a90-5670-42d0-b2d7-bc8ba85c510d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:51Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ff2064-3b74-4018-8c8b-2095d8cd624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ff2064-3b74-4018-8c8b-2095d8cd624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac907b5-d1c0-4c58-8a28-110a74b305b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ac907b5-d1c0-4c58-8a28-110a74b305b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42260a90-5670-42d0-b2d7-bc8ba85c510d', 'volume_name': 'volume-42260a90-5670-42d0-b2d7-bc8ba85c510d', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd210070-e378-4172-a5cf-695442e79549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd210070-e378-4172-a5cf-695442e79549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3890b887-d075-4067-b86b-644edfdccdb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:50 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Volume 42260a90-5670-42d0-b2d7-bc8ba85c510d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42260a90-5670-42d0-b2d7-bc8ba85c510d', 'volume_size': 1}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1737936862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42260a90-5670-42d0-b2d7-bc8ba85c510d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:51Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Creating volume 42260a90-5670-42d0-b2d7-bc8ba85c510d {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:35:50 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:35:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:50 devstack sudo[91824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d 1073741824
Jul 07 22:35:50 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Flow 'volume_create_manager' (894558c9-a60c-4229-8b47-6135cca3b022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc93bad9-8e12-4a60-b5f5-1cbd82498859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc93bad9-8e12-4a60-b5f5-1cbd82498859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2096333740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8784eb-3db9-4f3c-802a-11c229d9ff5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f48fc3aa47345c281871fec15270721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:51Z,use_quota=True,user_id='45345d0a674c4b83b3d0c1598faf0830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bab9f7-d4e2-4690-8b62-2a8a7cabe548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46bab9f7-d4e2-4690-8b62-2a8a7cabe548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064c5d5b-a8e7-46fd-a63f-1a8496f32f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064c5d5b-a8e7-46fd-a63f-1a8496f32f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e8784eb-3db9-4f3c-802a-11c229d9ff5c', 'volume_name': 'volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d509ca-be85-4e6b-8f3d-ae51d9068291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d509ca-be85-4e6b-8f3d-ae51d9068291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2827064-1e34-4389-8108-30b6743f1e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:51 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Volume 4e8784eb-3db9-4f3c-802a-11c229d9ff5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c', 'volume_size': 1}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:51 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d 1073741824" returned: 0 in 1.041s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:51 devstack sudo[91831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d
Jul 07 22:35:51 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:52 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d" returned: 0 in 0.808s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2096333740',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e8784eb-3db9-4f3c-802a-11c229d9ff5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f48fc3aa47345c281871fec15270721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:51Z,use_quota=True,user_id='45345d0a674c4b83b3d0c1598faf0830',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Creating volume 4e8784eb-3db9-4f3c-802a-11c229d9ff5c {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:35:52 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:52 devstack sudo[91834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c 1073741824
Jul 07 22:35:52 devstack sudo[91834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3890b887-d075-4067-b86b-644edfdccdb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42260a90-5670-42d0-b2d7-bc8ba85c510d', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19e5f8d-deff-41eb-bb0b-c62ab3fa6fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:52 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Volume volume-42260a90-5670-42d0-b2d7-bc8ba85c510d (42260a90-5670-42d0-b2d7-bc8ba85c510d): created successfully
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f19e5f8d-deff-41eb-bb0b-c62ab3fa6fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (bdf3c512-598a-484c-9895-60cea0703bc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:52 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f896aa8b-0561-4118-aed8-cdc285747c49 tempest-VolumesGetTest-491551484 None] Created volume successfully.
Jul 07 22:35:53 devstack sudo[91834]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c 1073741824" returned: 0 in 1.237s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:53 devstack sudo[91846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c
Jul 07 22:35:53 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:54 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (f8ce32d7-d2ca-4e65-be48-167a4ffb1a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd4dd77-6086-4d9e-baac-1f16d224681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" returned: 0 in 0.878s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] <== create_volume: return (2170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.173s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd4dd77-6086-4d9e-baac-1f16d224681f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-672725010',display_name='tempest-VolumesGetTest-Volume-1659850789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca39ae7-b7d6-4f23-91be-e41aa46c1035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:55Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95372058-50c1-4a46-a88b-8e216bf79987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95372058-50c1-4a46-a88b-8e216bf79987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95ff889-09ee-4d55-9fc8-dade68f886b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e95ff889-09ee-4d55-9fc8-dade68f886b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aca39ae7-b7d6-4f23-91be-e41aa46c1035', 'volume_name': 'volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfad5d67-1e8c-4535-9d6d-2f5b00c1442a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfad5d67-1e8c-4535-9d6d-2f5b00c1442a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a75ffb-a9d0-4292-b086-639929a72d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:54 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Volume aca39ae7-b7d6-4f23-91be-e41aa46c1035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035', 'volume_size': 1}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-672725010',display_name='tempest-VolumesGetTest-Volume-1659850789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aca39ae7-b7d6-4f23-91be-e41aa46c1035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:55Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Creating volume aca39ae7-b7d6-4f23-91be-e41aa46c1035 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:35:54 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2827064-1e34-4389-8108-30b6743f1e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6937a49-dfce-44ff-bc4d-4f248cb146ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:54 devstack sudo[91850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035 1073741824
Jul 07 22:35:54 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:54 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Volume volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c (4e8784eb-3db9-4f3c-802a-11c229d9ff5c): created successfully
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6937a49-dfce-44ff-bc4d-4f248cb146ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Flow 'volume_create_manager' (894558c9-a60c-4229-8b47-6135cca3b022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b9dbc800-8090-45e6-844e-65d0745692e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Created volume successfully.
Jul 07 22:35:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:55 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035 1073741824" returned: 0 in 1.056s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:56 devstack sudo[91856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035
Jul 07 22:35:56 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:56 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035" returned: 0 in 0.722s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.139s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a75ffb-a9d0-4292-b086-639929a72d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca6dad9-abbc-4127-b85b-10659b1e84da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Creating offline snapshot 96601734-b388-4fb1-af24-bc0619c48c56 of volume 4e8784eb-3db9-4f3c-802a-11c229d9ff5c {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:35:56 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Volume volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035 (aca39ae7-b7d6-4f23-91be-e41aa46c1035): created successfully
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca6dad9-abbc-4127-b85b-10659b1e84da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (f8ce32d7-d2ca-4e65-be48-167a4ffb1a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[499c43ce-eca4-4478-8702-ac0602fe5633]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-bf2666ec-c39e-41a5-a3b3-ce73032d405e tempest-VolumesGetTest-491551484 None] Created volume successfully.
Jul 07 22:35:56 devstack sudo[91859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c
Jul 07 22:35:56 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:57 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" returned: 0 in 0.964s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:57 devstack sudo[91867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56 1G
Jul 07 22:35:57 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-aca39ae7-b7d6-4f23-91be-e41aa46c1035-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Lock "cinder-aca39ae7-b7d6-4f23-91be-e41aa46c1035-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-quobyte-aca39ae7-b7d6-4f23-91be-e41aa46c1035" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-aca39ae7-b7d6-4f23-91be-e41aa46c1035" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:58 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[535df783-c872-4dda-8a6a-bf1023ac6087]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:58 devstack sudo[91869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035
Jul 07 22:35:58 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:58 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56 1G" returned: 0 in 1.188s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:59 devstack sudo[91874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56
Jul 07 22:35:59 devstack sudo[91874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:59 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035" returned: 0 in 1.237s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:59 devstack sudo[91879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035
Jul 07 22:35:59 devstack sudo[91879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:59 devstack sudo[91874]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56" returned: 0 in 0.995s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:59 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56 is being set with open permissions: ugo+rw
Jul 07 22:35:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:00 devstack sudo[91889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56
Jul 07 22:36:00 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:00 devstack sudo[91879]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-aca39ae7-b7d6-4f23-91be-e41aa46c1035" returned: 0 in 0.952s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-aca39ae7-b7d6-4f23-91be-e41aa46c1035" released by "delete_volume" :: held 2.245s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Created reservations ['baa750f3-76bf-47fd-902f-26befb6af21e', '70f4dc91-3f90-4d63-82d7-cb99d7063bfc', '3aaef273-71b0-4ea6-a8b2-544b3ed7e83f', '076910d6-5d91-4c85-bc50-14b898a2454b'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:00 devstack sudo[91904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:36:00 devstack sudo[91904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:00 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56" returned: 0 in 0.983s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:01 devstack sudo[91907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.info
Jul 07 22:36:01 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:01 devstack sudo[91904]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.874s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Deleted volume successfully.
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-42260a90-5670-42d0-b2d7-bc8ba85c510d-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-132006af-1519-4708-96a2-ebdf17bfc65b tempest-VolumesGetTest-491551484 None] Lock "cinder-aca39ae7-b7d6-4f23-91be-e41aa46c1035-delete_volume" released by "delete_volume" :: held 3.486s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Lock "cinder-42260a90-5670-42d0-b2d7-bc8ba85c510d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-quobyte-42260a90-5670-42d0-b2d7-bc8ba85c510d" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-42260a90-5670-42d0-b2d7-bc8ba85c510d" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b16df1-fab1-487b-8c23-fa33c9c9938a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:01 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.info" returned: 0 in 0.850s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:01 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.info is being set with open permissions: ugo+rw
Jul 07 22:36:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:01 devstack sudo[91914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.info
Jul 07 22:36:01 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:01 devstack sudo[91913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d
Jul 07 22:36:01 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:02 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.info" returned: 0 in 0.851s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.996s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-bf38fb97-7d50-4674-9c6d-10d3d07bc8ff tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Create snapshot completed successfully
Jul 07 22:36:02 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d" returned: 0 in 1.026s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:02 devstack sudo[91922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d
Jul 07 22:36:02 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:03 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42260a90-5670-42d0-b2d7-bc8ba85c510d" returned: 0 in 0.741s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Acquiring lock "cinder-96601734-b388-4fb1-af24-bc0619c48c56-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-42260a90-5670-42d0-b2d7-bc8ba85c510d" released by "delete_volume" :: held 1.850s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "cinder-96601734-b388-4fb1-af24-bc0619c48c56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Acquiring lock "cinder-quobyte-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "cinder-quobyte-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Acquiring lock "cinder-quobyte-96601734-b388-4fb1-af24-bc0619c48c56" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "cinder-quobyte-96601734-b388-4fb1-af24-bc0619c48c56" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Deleting offline snapshot 96601734-b388-4fb1-af24-bc0619c48c56 of volume 4e8784eb-3db9-4f3c-802a-11c229d9ff5c {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] snapshot_file for this snap is: volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e0e3a4-ba36-483e-bfc5-302e44d57406]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Created reservations ['93251332-a877-4d89-a30d-480344606784', '1dd47a58-8dc7-46cb-9861-f85e541626df', '546f6f63-995f-4406-9373-72efcb0bed84', 'ccebe867-b936-4773-991c-f49594488e36'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:03 devstack sudo[91925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56
Jul 07 22:36:03 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:04 devstack sudo[91927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:36:04 devstack sudo[91927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:04 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:04 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (2fb55f3c-06f3-4f52-bd2e-8d299ba7fdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900209e4-d4b8-48c0-9ae5-e1ac829014e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56" returned: 0 in 1.299s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a54e38-3b80-48e3-8bb2-2e5269b1056b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (900209e4-d4b8-48c0-9ae5-e1ac829014e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-22199283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89617278-f81e-493b-bf52-f9ddca733950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:05Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed479eb3-b5dc-4f68-bc57-566a3b52c90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed479eb3-b5dc-4f68-bc57-566a3b52c90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cddc2f67-60df-4c5d-84e2-f0bb1a0b5d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cddc2f67-60df-4c5d-84e2-f0bb1a0b5d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89617278-f81e-493b-bf52-f9ddca733950', 'volume_name': 'volume-89617278-f81e-493b-bf52-f9ddca733950', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b646181a-1182-4ed1-99e1-7d658af435d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b646181a-1182-4ed1-99e1-7d658af435d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b935ba6d-a207-44c1-967b-c04afd88c2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:05 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Volume 89617278-f81e-493b-bf52-f9ddca733950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89617278-f81e-493b-bf52-f9ddca733950', 'volume_size': 1}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-22199283',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89617278-f81e-493b-bf52-f9ddca733950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:05Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Creating volume 89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:36:05 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:05 devstack sudo[91965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 1073741824
Jul 07 22:36:05 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:05 devstack sudo[91927]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.314s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:05 devstack sudo[91961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c
Jul 07 22:36:05 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:05 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Deleted volume successfully.
Jul 07 22:36:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0140a68-4e90-4fe2-b387-fb9514544f04 tempest-VolumesGetTest-491551484 None] Lock "cinder-42260a90-5670-42d0-b2d7-bc8ba85c510d-delete_volume" released by "delete_volume" :: held 3.587s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:06 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" returned: 0 in 1.034s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:06 devstack sudo[91989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56
Jul 07 22:36:06 devstack sudo[91989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:06 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 1073741824" returned: 0 in 1.079s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:06 devstack sudo[91991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950
Jul 07 22:36:06 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:07 devstack sudo[91989]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56" returned: 0 in 1.076s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:07 devstack sudo[92031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56
Jul 07 22:36:07 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:07 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950" returned: 0 in 0.966s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:36:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b935ba6d-a207-44c1-967b-c04afd88c2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89617278-f81e-493b-bf52-f9ddca733950', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e59f93-ea91-49d4-816c-8144008ca1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:07 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Volume volume-89617278-f81e-493b-bf52-f9ddca733950 (89617278-f81e-493b-bf52-f9ddca733950): created successfully
Jul 07 22:36:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61e59f93-ea91-49d4-816c-8144008ca1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (2fb55f3c-06f3-4f52-bd2e-8d299ba7fdc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:07 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3de3d4f5-5070-4ba3-b427-da0a0f278b29 tempest-VolumesGetTest-491551484 None] Created volume successfully.
Jul 07 22:36:08 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c.96601734-b388-4fb1-af24-bc0619c48c56" returned: 0 in 1.020s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "cinder-quobyte-96601734-b388-4fb1-af24-bc0619c48c56" released by "_delete_snapshot" :: held 4.602s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "cinder-quobyte-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" released by "delete_snapshot" :: held 4.634s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Created reservations ['a6bbb73b-1806-4219-b318-494b60d50df4', '663eea15-b514-47a5-a76d-c7a957ec88dd', '57c424df-b476-4cc0-a88e-3d2dc24675b4', '899bb76c-6ad9-4ba3-97a0-fd910248f1c3'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:08 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Delete snapshot completed successfully.
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a0b768ca-483e-4073-b50a-c5941c4d8337 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "cinder-96601734-b388-4fb1-af24-bc0619c48c56-delete_snapshot" released by "delete_snapshot" :: held 4.889s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (bab36bf8-4845-4f26-9500-d8a15d48d879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d81285-ea38-46b7-b625-8fa3204831da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d81285-ea38-46b7-b625-8fa3204831da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1186937412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fdc590b-eb1d-4c66-b417-5db1b5f67d51,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=89617278-f81e-493b-bf52-f9ddca733950,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:09Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cd4b17-7b02-450c-b76d-c3583013e25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cd4b17-7b02-450c-b76d-c3583013e25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b621910-de38-4fe0-8adb-d2a49db14aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b621910-de38-4fe0-8adb-d2a49db14aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2fdc590b-eb1d-4c66-b417-5db1b5f67d51', 'volume_name': 'volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51', 'volume_size': 1, 'source_volid': '89617278-f81e-493b-bf52-f9ddca733950', 'source_volstatus': 'available'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d2e0f5-e8a1-4a3d-b0c3-36dcdccf506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d2e0f5-e8a1-4a3d-b0c3-36dcdccf506a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7f466d-734d-4396-bd7b-aeaa7fb17d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:08 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Volume 2fdc590b-eb1d-4c66-b417-5db1b5f67d51: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51', 'volume_size': 1, 'source_volid': '89617278-f81e-493b-bf52-f9ddca733950', 'source_volstatus': 'available'}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:08 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Cloning volume 89617278-f81e-493b-bf52-f9ddca733950 to volume 2fdc590b-eb1d-4c66-b417-5db1b5f67d51
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Creating offline snapshot e9ad4f40-555c-470b-9b1e-ed0f805f0917 of volume 89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcaf9e5-a8b7-467c-97af-5cf4a273ddde]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Acquiring lock "cinder-4e8784eb-3db9-4f3c-802a-11c229d9ff5c-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:09 devstack sudo[92060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950
Jul 07 22:36:09 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "cinder-4e8784eb-3db9-4f3c-802a-11c229d9ff5c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Acquiring lock "cinder-quobyte-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "cinder-quobyte-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:09 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6576536-a50e-42aa-84a2-8562c706badf]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:09 devstack sudo[92062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c
Jul 07 22:36:09 devstack sudo[92062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:10 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950" returned: 0 in 1.635s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:10 devstack sudo[92071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 1G
Jul 07 22:36:10 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:10 devstack sudo[92062]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" returned: 0 in 1.373s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:10 devstack sudo[92073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c
Jul 07 22:36:10 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:11 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" returned: 0 in 1.013s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "cinder-quobyte-4e8784eb-3db9-4f3c-802a-11c229d9ff5c" released by "delete_volume" :: held 2.496s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:11 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 1G" returned: 0 in 1.193s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89617278-f81e-493b-bf52-f9ddca733950 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:11 devstack sudo[92082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89617278-f81e-493b-bf52-f9ddca733950 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917
Jul 07 22:36:11 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:11 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Created reservations ['d105c26d-db31-4f95-bc75-d9d62d2881e2', 'a667a8f5-5074-45f2-8851-08514db22911', 'b633ad4a-d348-4dfb-b546-1290dbb518f0', 'ec897ef6-4bc3-41ba-9ec2-c648b4c35ab9'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:12 devstack sudo[92084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:36:12 devstack sudo[92084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:13 devstack sudo[92084]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:13 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.293s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:13 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89617278-f81e-493b-bf52-f9ddca733950 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917" returned: 0 in 1.564s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:13 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 is being set with open permissions: ugo+rw
Jul 07 22:36:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Deleted volume successfully.
Jul 07 22:36:13 devstack sudo[92091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917
Jul 07 22:36:13 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5afd4ff1-6237-4d3b-9908-2f368827fc76 tempest-VolumeSnapshotQuotasNegativeTestJSON-1690089075 None] Lock "cinder-4e8784eb-3db9-4f3c-802a-11c229d9ff5c-delete_volume" released by "delete_volume" :: held 4.261s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:14 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917" returned: 0 in 1.226s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:14 devstack sudo[92094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.info
Jul 07 22:36:14 devstack sudo[92094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:15 devstack sudo[92094]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.info" returned: 0 in 1.180s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:15 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.info is being set with open permissions: ugo+rw
Jul 07 22:36:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:15 devstack sudo[92101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.info
Jul 07 22:36:15 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:17 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.info" returned: 0 in 1.181s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-quobyte-2fdc590b-eb1d-4c66-b417-5db1b5f67d51" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-2fdc590b-eb1d-4c66-b417-5db1b5f67d51" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] snapshot: e9ad4f40-555c-470b-9b1e-ed0f805f0917, volume: 2fdc590b-eb1d-4c66-b417-5db1b5f67d51,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aaa175-a0d6-464c-a031-2dac30895e43]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:17 devstack sudo[92104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917
Jul 07 22:36:17 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:18 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917" returned: 0 in 1.338s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89617278-f81e-493b-bf52-f9ddca733950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:36:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:36:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:36:18 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aaba60-19f0-43af-ad42-70524c520f43]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:18 devstack sudo[92111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950
Jul 07 22:36:18 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:19 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950" returned: 0 in 1.085s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:19 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51 not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:36:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:19 devstack sudo[92116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51
Jul 07 22:36:19 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:23 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=62,cinder:INSERT=20,cinder:UPDATE=101,cinder:DELETE=11 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:36:24 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=88,cinder:SELECT=71,cinder:INSERT=27,cinder:DELETE=6 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:36:26 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51" returned: 0 in 6.705s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f4670a-7277-4557-b9e1-62816f824c2b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:26 devstack sudo[92153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950
Jul 07 22:36:26 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Flow 'volume_create_manager' (ee8afb7f-e124-4829-9fa4-954a7ad3d4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d041854-a4ac-4b0f-8975-529dc6618f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d041854-a4ac-4b0f-8975-529dc6618f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1672803055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4fc895-a51b-4de1-9762-029bef22dcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b89db70bb8a42acb33836759865e9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:27Z,use_quota=True,user_id='41666584bbb148e8b643aa8bcea723eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83d2803-a6b7-4b3b-b543-e9a36e5eac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83d2803-a6b7-4b3b-b543-e9a36e5eac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b7346d-e87c-4497-9a14-6613b9bf0777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b7346d-e87c-4497-9a14-6613b9bf0777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4fc895-a51b-4de1-9762-029bef22dcec', 'volume_name': 'volume-fd4fc895-a51b-4de1-9762-029bef22dcec', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f012ca7-8089-4188-84d4-8b9e9305c3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f012ca7-8089-4188-84d4-8b9e9305c3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d1e87f-f897-4a21-bdea-6642f883d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:26 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Volume fd4fc895-a51b-4de1-9762-029bef22dcec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4fc895-a51b-4de1-9762-029bef22dcec', 'volume_size': 1}
Jul 07 22:36:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:27 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950" returned: 0 in 1.009s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:27 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:36:27 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Converted 1024.00 MB image at 152.70 MB/s
Jul 07 22:36:27 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51 is being set with open permissions: ugo+rw
Jul 07 22:36:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:27 devstack sudo[92158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51
Jul 07 22:36:27 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:28 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51" returned: 0 in 0.704s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-2fdc590b-eb1d-4c66-b417-5db1b5f67d51" released by "_copy_volume_from_snapshot" :: held 10.980s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-quobyte-e9ad4f40-555c-470b-9b1e-ed0f805f0917" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-e9ad4f40-555c-470b-9b1e-ed0f805f0917" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Deleting offline snapshot e9ad4f40-555c-470b-9b1e-ed0f805f0917 of volume 89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:36:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] snapshot_file for this snap is: volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:36:28 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc4f48f-c17a-4f24-856f-d77dcbac9022]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:28 devstack sudo[92161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917
Jul 07 22:36:28 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:29 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917" returned: 0 in 0.926s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89617278-f81e-493b-bf52-f9ddca733950(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:36:29 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b964883-7abf-484c-a5b5-20d36323221d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:29 devstack sudo[92166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950
Jul 07 22:36:29 devstack sudo[92166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:29 devstack sudo[92166]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950" returned: 0 in 0.879s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:30 devstack sudo[92172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917
Jul 07 22:36:30 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:30 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917" returned: 0 in 0.840s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:30 devstack sudo[92182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917
Jul 07 22:36:30 devstack sudo[92182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:31 devstack sudo[92182]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950.e9ad4f40-555c-470b-9b1e-ed0f805f0917" returned: 0 in 0.725s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-e9ad4f40-555c-470b-9b1e-ed0f805f0917" released by "_delete_snapshot" :: held 3.487s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.796s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.883s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1672803055',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4fc895-a51b-4de1-9762-029bef22dcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b89db70bb8a42acb33836759865e9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:27Z,use_quota=True,user_id='41666584bbb148e8b643aa8bcea723eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Creating volume fd4fc895-a51b-4de1-9762-029bef22dcec {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:36:31 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:31 devstack sudo[92197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec 1073741824
Jul 07 22:36:31 devstack sudo[92197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7f466d-734d-4396-bd7b-aeaa7fb17d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51', 'volume_size': 1, 'source_volid': '89617278-f81e-493b-bf52-f9ddca733950', 'source_volstatus': 'available'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4980b12c-fc74-4414-aff4-643370b2e1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:31 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Volume volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51 (2fdc590b-eb1d-4c66-b417-5db1b5f67d51): created successfully
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4980b12c-fc74-4414-aff4-643370b2e1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (bab36bf8-4845-4f26-9500-d8a15d48d879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:31 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-44bc31da-1d31-4476-83b4-ed582cf6a219 tempest-VolumesGetTest-491551484 None] Created volume successfully.
Jul 07 22:36:32 devstack sudo[92197]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec 1073741824" returned: 0 in 0.936s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:32 devstack sudo[92203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec
Jul 07 22:36:32 devstack sudo[92203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (65c2c96f-8b63-4553-9520-173ad599df97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faebab29-8564-41f1-94a9-0c0f1fde5074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faebab29-8564-41f1-94a9-0c0f1fde5074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-349572849',display_name='tempest-VolumesGetTest-Volume-166665917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882a9377-cc13-4892-86ea-b9b918c36f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:33Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:33 devstack sudo[92203]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546afcc7-5fd1-419f-9716-673606a008ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (546afcc7-5fd1-419f-9716-673606a008ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1c15d5-69a5-46f6-8660-14b84f8c9c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1c15d5-69a5-46f6-8660-14b84f8c9c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '882a9377-cc13-4892-86ea-b9b918c36f4f', 'volume_name': 'volume-882a9377-cc13-4892-86ea-b9b918c36f4f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1710fd95-952e-4036-85ef-52a0cbb8ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1710fd95-952e-4036-85ef-52a0cbb8ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c646ef-5d05-471c-98c0-fbe82cf3436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Volume 882a9377-cc13-4892-86ea-b9b918c36f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-882a9377-cc13-4892-86ea-b9b918c36f4f', 'volume_size': 1}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec" returned: 0 in 0.784s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-349572849',display_name='tempest-VolumesGetTest-Volume-166665917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=882a9377-cc13-4892-86ea-b9b918c36f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:33Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Creating volume 882a9377-cc13-4892-86ea-b9b918c36f4f {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:36:33 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d1e87f-f897-4a21-bdea-6642f883d17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4fc895-a51b-4de1-9762-029bef22dcec', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:33 devstack sudo[92206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f 1073741824
Jul 07 22:36:33 devstack sudo[92206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aadb587-60bc-441e-be0d-f4ee2dfcd9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Volume volume-fd4fc895-a51b-4de1-9762-029bef22dcec (fd4fc895-a51b-4de1-9762-029bef22dcec): created successfully
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aadb587-60bc-441e-be0d-f4ee2dfcd9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Flow 'volume_create_manager' (ee8afb7f-e124-4829-9fa4-954a7ad3d4da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a43baf9d-55fb-4ee9-bdc9-bcbd5a1b1294 tempest-VolumesMetadataTest-26485510 None] Created volume successfully.
Jul 07 22:36:34 devstack sudo[92206]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f 1073741824" returned: 0 in 1.156s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:34 devstack sudo[92242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f
Jul 07 22:36:34 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Acquiring lock "cinder-fd4fc895-a51b-4de1-9762-029bef22dcec-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Lock "cinder-fd4fc895-a51b-4de1-9762-029bef22dcec-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Acquiring lock "cinder-quobyte-fd4fc895-a51b-4de1-9762-029bef22dcec" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Lock "cinder-quobyte-fd4fc895-a51b-4de1-9762-029bef22dcec" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:35 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f" returned: 0 in 1.014s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f44186-ac8c-4e19-bf87-e7b4f80e09d7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c646ef-5d05-471c-98c0-fbe82cf3436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-882a9377-cc13-4892-86ea-b9b918c36f4f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf27e15f-5b22-4d25-b99a-ecc4b14f23a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:35 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Volume volume-882a9377-cc13-4892-86ea-b9b918c36f4f (882a9377-cc13-4892-86ea-b9b918c36f4f): created successfully
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf27e15f-5b22-4d25-b99a-ecc4b14f23a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (65c2c96f-8b63-4553-9520-173ad599df97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:35 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5b307769-8662-4087-b2fd-aa7f488f0e33 tempest-VolumesGetTest-491551484 None] Created volume successfully.
Jul 07 22:36:35 devstack sudo[92266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec
Jul 07 22:36:35 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Flow 'volume_create_manager' (bbd3d34a-f51a-47e9-afce-ecd8ad92ae46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23b7c29-cf0d-48e4-a3e6-bea471f5ac09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23b7c29-cf0d-48e4-a3e6-bea471f5ac09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-404718611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a805c8a-6b59-491b-85bb-7d63c89b2b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8de0f1ca62a4022b63df09a90222b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:36Z,use_quota=True,user_id='6512fb0648c64067b80eb4e1b1ddc1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73d5fe7-b250-4cf2-93b9-ef44b5cef817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c73d5fe7-b250-4cf2-93b9-ef44b5cef817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d52b521-b65b-4605-b078-e14d0c4fd755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d52b521-b65b-4605-b078-e14d0c4fd755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a805c8a-6b59-491b-85bb-7d63c89b2b49', 'volume_name': 'volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4827461b-2238-4a8f-9884-6af8d121bf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4827461b-2238-4a8f-9884-6af8d121bf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90129af-8cc2-47b4-8f4d-b499a2e10259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:36 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Volume 9a805c8a-6b59-491b-85bb-7d63c89b2b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49', 'volume_size': 1}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-404718611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a805c8a-6b59-491b-85bb-7d63c89b2b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8de0f1ca62a4022b63df09a90222b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:36Z,use_quota=True,user_id='6512fb0648c64067b80eb4e1b1ddc1b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Creating volume 9a805c8a-6b59-491b-85bb-7d63c89b2b49 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:36:36 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:36 devstack sudo[92277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49 1073741824
Jul 07 22:36:36 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:36 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec" returned: 0 in 1.139s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:36 devstack sudo[92293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec
Jul 07 22:36:36 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-882a9377-cc13-4892-86ea-b9b918c36f4f-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Lock "cinder-882a9377-cc13-4892-86ea-b9b918c36f4f-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-quobyte-882a9377-cc13-4892-86ea-b9b918c36f4f" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-882a9377-cc13-4892-86ea-b9b918c36f4f" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:37 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ee728f-9239-4775-9d02-8da9d8b63199]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:37 devstack sudo[92295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f
Jul 07 22:36:37 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:37 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49 1073741824" returned: 0 in 1.620s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:37 devstack sudo[92304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49
Jul 07 22:36:37 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:38 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd4fc895-a51b-4de1-9762-029bef22dcec" returned: 0 in 1.239s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Lock "cinder-quobyte-fd4fc895-a51b-4de1-9762-029bef22dcec" released by "delete_volume" :: held 2.447s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Created reservations ['033523a5-d9b6-4c61-a4cf-c62d0b84d075', 'c4a306f0-f3e2-4191-a990-0fff1c203a98', '0db7efa5-56fd-497d-b469-d308a7d92604', '0b2c0bd2-7ce9-498a-aec8-cf80f668d596'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:38 devstack sudo[92309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:36:38 devstack sudo[92309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:38 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f" returned: 0 in 1.538s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:38 devstack sudo[92311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f
Jul 07 22:36:38 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:39 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49" returned: 0 in 1.321s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] <== create_volume: return (3026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:36:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.032s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c90129af-8cc2-47b4-8f4d-b499a2e10259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976ad3ef-838c-4d7a-9754-e0ecb3fe32d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:39 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Volume volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49 (9a805c8a-6b59-491b-85bb-7d63c89b2b49): created successfully
Jul 07 22:36:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (976ad3ef-838c-4d7a-9754-e0ecb3fe32d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Flow 'volume_create_manager' (bbd3d34a-f51a-47e9-afce-ecd8ad92ae46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:39 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-64bd2990-6dab-4094-b493-b079ab53e104 tempest-ServerActionsTestOtherA-13739957 None] Created volume successfully.
Jul 07 22:36:39 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-882a9377-cc13-4892-86ea-b9b918c36f4f" returned: 0 in 1.276s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-882a9377-cc13-4892-86ea-b9b918c36f4f" released by "delete_volume" :: held 2.876s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:39 devstack sudo[92309]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.555s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:40 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Deleted volume successfully.
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4cf736cd-ebe0-44f9-b3f2-5a229d8e2bc8 tempest-VolumesMetadataTest-26485510 None] Lock "cinder-fd4fc895-a51b-4de1-9762-029bef22dcec-delete_volume" released by "delete_volume" :: held 4.493s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Created reservations ['67e17a86-b47a-4b77-8a26-19261927c35a', 'a215711a-6197-4a77-b6db-ead2e158cc04', '2455a861-ddc4-4d24-a55d-f6d117974f99', '59861fbe-e234-434d-bb51-7417c5b45b98'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:40 devstack sudo[92317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:36:40 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-2fdc590b-eb1d-4c66-b417-5db1b5f67d51-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Lock "cinder-2fdc590b-eb1d-4c66-b417-5db1b5f67d51-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-quobyte-2fdc590b-eb1d-4c66-b417-5db1b5f67d51" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-2fdc590b-eb1d-4c66-b417-5db1b5f67d51" acquired by "delete_volume" :: waited 0.037s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[40167149-e220-4c3d-b69b-36eaf9f4f949]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:41 devstack sudo[92319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51
Jul 07 22:36:41 devstack sudo[92319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:41 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.028s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:41 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:41 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Deleted volume successfully.
Jul 07 22:36:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-914d318d-123b-464c-9128-39459a98515d tempest-VolumesGetTest-491551484 None] Lock "cinder-882a9377-cc13-4892-86ea-b9b918c36f4f-delete_volume" released by "delete_volume" :: held 4.365s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:42 devstack sudo[92319]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51" returned: 0 in 1.179s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:42 devstack sudo[92328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51
Jul 07 22:36:42 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:43 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-2fdc590b-eb1d-4c66-b417-5db1b5f67d51" returned: 0 in 1.000s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-2fdc590b-eb1d-4c66-b417-5db1b5f67d51" released by "delete_volume" :: held 2.272s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Created reservations ['506376b1-afb3-4da6-82d7-455b184bfb0a', '05cd2030-3209-41b8-b669-50005aef4698', '46d73956-bdbb-4d18-9fdc-17149a1155a5', '23fbe603-9e24-44c1-962f-dc1fd1bc98e3'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:43 devstack sudo[92340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:36:43 devstack sudo[92340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:43 devstack sudo[92343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:36:43 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-89617278-f81e-493b-bf52-f9ddca733950-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Lock "cinder-89617278-f81e-493b-bf52-f9ddca733950-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-quobyte-89617278-f81e-493b-bf52-f9ddca733950" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-89617278-f81e-493b-bf52-f9ddca733950" acquired by "delete_volume" :: waited 0.038s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:44 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.238s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 8 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb019a11-66be-4a14-88b1-c5e6697b7cd8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:44 devstack sudo[92340]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.446s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:44 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Deleted volume successfully.
Jul 07 22:36:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf3dd6d8-23d0-47fa-9f9d-9970cc3affba tempest-VolumesGetTest-491551484 None] Lock "cinder-2fdc590b-eb1d-4c66-b417-5db1b5f67d51-delete_volume" released by "delete_volume" :: held 4.075s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:44 devstack sudo[92349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950
Jul 07 22:36:44 devstack sudo[92349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:45 devstack sudo[92349]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950" returned: 0 in 1.053s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:45 devstack sudo[92354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950
Jul 07 22:36:45 devstack sudo[92354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:46 devstack sudo[92354]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-89617278-f81e-493b-bf52-f9ddca733950" returned: 0 in 0.728s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-89617278-f81e-493b-bf52-f9ddca733950" released by "delete_volume" :: held 1.890s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Created reservations ['541641cd-ace2-4c10-84e7-6277dd455d2e', '1659a2f3-42b9-49e9-af46-1c307699d425', 'de2f3661-8b69-423a-b149-3eba317c83e0', '8bcf91f8-50ac-4679-8f8e-18f4054162c0'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:46 devstack sudo[92357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:36:46 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Flow 'volume_create_manager' (c7bcb122-738a-443b-8e0c-646c2b920a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e7ed46-f540-434b-af2e-fd2b3a1393ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50e7ed46-f540-434b-af2e-fd2b3a1393ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-426152586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b8b88b-2866-467c-9b78-cf00d8c96272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13e2d6310b34fd2a39463f16ddc5e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:47Z,use_quota=True,user_id='2da219c1dbf74f97b76e25eabaddddc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a054ba29-ad3d-4357-8669-49d2eabf5749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a054ba29-ad3d-4357-8669-49d2eabf5749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe71b816-eba7-4139-9e26-cf89b3b8c325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe71b816-eba7-4139-9e26-cf89b3b8c325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b8b88b-2866-467c-9b78-cf00d8c96272', 'volume_name': 'volume-18b8b88b-2866-467c-9b78-cf00d8c96272', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9448db-9be9-4274-ae34-954442b6a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c9448db-9be9-4274-ae34-954442b6a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fcbe79-1c2b-4d87-a2d4-8cb2fb2900a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:47 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Volume 18b8b88b-2866-467c-9b78-cf00d8c96272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b8b88b-2866-467c-9b78-cf00d8c96272', 'volume_size': 1}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-426152586',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b8b88b-2866-467c-9b78-cf00d8c96272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13e2d6310b34fd2a39463f16ddc5e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:47Z,use_quota=True,user_id='2da219c1dbf74f97b76e25eabaddddc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Creating volume 18b8b88b-2866-467c-9b78-cf00d8c96272 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:36:47 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:47 devstack sudo[92359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272 1073741824
Jul 07 22:36:47 devstack sudo[92359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:47 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.963s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Deleted volume successfully.
Jul 07 22:36:47 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-62fb2e16-a584-49ec-8328-dee499a9eba7 tempest-VolumesGetTest-491551484 None] Lock "cinder-89617278-f81e-493b-bf52-f9ddca733950-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:48 devstack sudo[92359]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272 1073741824" returned: 0 in 1.111s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:48 devstack sudo[92366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272
Jul 07 22:36:48 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (bf477bda-c66d-4420-b0b0-476db220cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322b2ffd-beaa-4748-b3a2-0f67d1e23c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (322b2ffd-beaa-4748-b3a2-0f67d1e23c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-14501839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5692a132-a723-4957-9e20-1d734bb5edfb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:48Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ca5f49-4b18-4eeb-907e-a96cb484f867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ca5f49-4b18-4eeb-907e-a96cb484f867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69b62e9-2ac8-4efe-86cc-6dcce833a49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.image.glance [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Creating Keystone auth plugin from conf {{(pid=88077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69b62e9-2ac8-4efe-86cc-6dcce833a49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5692a132-a723-4957-9e20-1d734bb5edfb', 'volume_name': 'volume-5692a132-a723-4957-9e20-1d734bb5edfb', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72c3ed80>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db974e8b-5f36-4895-8b9f-c4c4fb2329a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db974e8b-5f36-4895-8b9f-c4c4fb2329a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6be06fc-08b4-424c-a8fc-f49b0239de0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:48 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Volume 5692a132-a723-4957-9e20-1d734bb5edfb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5692a132-a723-4957-9e20-1d734bb5edfb', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72c3ed80>}
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Trying to clone 5692a132-a723-4957-9e20-1d734bb5edfb from image 92445205-e8e3-4b89-b69d-7e05b2a64f9f at location (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]). {{(pid=88077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:36:49 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272" returned: 0 in 0.883s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0fcbe79-1c2b-4d87-a2d4-8cb2fb2900a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b8b88b-2866-467c-9b78-cf00d8c96272', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d7c89f-73d1-43e3-8d0f-7fc23d989739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:49 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Volume volume-18b8b88b-2866-467c-9b78-cf00d8c96272 (18b8b88b-2866-467c-9b78-cf00d8c96272): created successfully
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d7c89f-73d1-43e3-8d0f-7fc23d989739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Flow 'volume_create_manager' (c7bcb122-738a-443b-8e0c-646c2b920a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:49 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-7b27e748-0feb-4c3b-8605-e793b983d870 tempest-VolumesTransfersV355Test-1388054231 None] Created volume successfully.
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:36:49 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9c4ed4-3446-4226-9602-5f02da6f7fbe]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:49 devstack sudo[92390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD
Jul 07 22:36:49 devstack sudo[92390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:50 devstack sudo[92390]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD" returned: 0 in 1.158s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:50 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Temporary image 92445205-e8e3-4b89-b69d-7e05b2a64f9f is fetched for user 389c5d1b12e14388b4a7f2b08874b142. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:36:50 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a13ae63-eeb4-436f-8451-8a634b2f0e4a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:51 devstack sudo[92417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD
Jul 07 22:36:51 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:51 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-dc00295d-6a12-480d-8757-04b708bf56c8 tempest-VolumesTransfersV355Test-346949091 None] Transfer volume completed successfully.
Jul 07 22:36:51 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD" returned: 0 in 0.894s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-14501839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5692a132-a723-4957-9e20-1d734bb5edfb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:48Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Creating volume 5692a132-a723-4957-9e20-1d734bb5edfb {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:36:51 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:36:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:51 devstack sudo[92430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb 1073741824
Jul 07 22:36:51 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Acquiring lock "cinder-18b8b88b-2866-467c-9b78-cf00d8c96272-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Lock "cinder-18b8b88b-2866-467c-9b78-cf00d8c96272-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Acquiring lock "cinder-quobyte-18b8b88b-2866-467c-9b78-cf00d8c96272" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Lock "cinder-quobyte-18b8b88b-2866-467c-9b78-cf00d8c96272" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:52 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24a7fdf-6866-4fb8-a75c-5b7bbf74b980]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:52 devstack sudo[92435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272
Jul 07 22:36:52 devstack sudo[92435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:52 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb 1073741824" returned: 0 in 0.943s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:52 devstack sudo[92437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb
Jul 07 22:36:52 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:53 devstack sudo[92435]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272" returned: 0 in 0.776s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:53 devstack sudo[92442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272
Jul 07 22:36:53 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:53 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb" returned: 0 in 0.706s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] <== create_volume: return (1701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:36:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:53 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Attempting download of 92445205-e8e3-4b89-b69d-7e05b2a64f9f ((None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}])) to volume 5692a132-a723-4957-9e20-1d734bb5edfb. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:36:53 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40a527e-f967-4fda-a69f-9194c060b65b]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1kqjpc3l {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:53 devstack sudo[92445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1kqjpc3l
Jul 07 22:36:53 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:54 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18b8b88b-2866-467c-9b78-cf00d8c96272" returned: 0 in 0.771s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Lock "cinder-quobyte-18b8b88b-2866-467c-9b78-cf00d8c96272" released by "delete_volume" :: held 1.593s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Created reservations ['3fedc678-e9a3-4677-9cac-ac95dc04ef43', 'a1be0e4a-b3d9-41d5-b103-6477ce0d6c91', '06541080-58cf-41bf-a742-9ccd6645cf0d', '0ca38fce-80c2-4c7a-b613-743f76d46201'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:54 devstack sudo[92449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:36:54 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:54 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1kqjpc3l" returned: 0 in 0.793s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1kqjpc3l {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:54 devstack sudo[92452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1kqjpc3l
Jul 07 22:36:54 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:54 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.722s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:54 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:54 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Deleted volume successfully.
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-405f7435-0b25-42ce-a441-7ae41cce42dc tempest-VolumesTransfersV355Test-596237262 None] Lock "cinder-18b8b88b-2866-467c-9b78-cf00d8c96272-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:55 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1kqjpc3l" returned: 1 in 0.965s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1kqjpc3l' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa91c5f-6481-4959-a497-6182857d4387]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Flow 'volume_create_manager' (c4ce71b2-e4cd-4e03-9d3d-303574ccecd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f677ea2-d186-40d9-bc01-82b2d57222a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f677ea2-d186-40d9-bc01-82b2d57222a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-43605522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a895f8-cffc-4444-a80d-64deb31d641e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13e2d6310b34fd2a39463f16ddc5e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:55Z,use_quota=True,user_id='2da219c1dbf74f97b76e25eabaddddc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:55 devstack sudo[92475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD
Jul 07 22:36:55 devstack sudo[92475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b996ff1-9b38-41cf-aee5-edcab3190cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b996ff1-9b38-41cf-aee5-edcab3190cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4abd53-a363-4f90-b8bc-96887edfd9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f4abd53-a363-4f90-b8bc-96887edfd9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18a895f8-cffc-4444-a80d-64deb31d641e', 'volume_name': 'volume-18a895f8-cffc-4444-a80d-64deb31d641e', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad57cc8e-546b-447a-9cf4-fa57f1374127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad57cc8e-546b-447a-9cf4-fa57f1374127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9ad8d5-a02f-4a1a-b820-10c4aa4e1d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:55 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Volume 18a895f8-cffc-4444-a80d-64deb31d641e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18a895f8-cffc-4444-a80d-64deb31d641e', 'volume_size': 1}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-43605522',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18a895f8-cffc-4444-a80d-64deb31d641e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c13e2d6310b34fd2a39463f16ddc5e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:55Z,use_quota=True,user_id='2da219c1dbf74f97b76e25eabaddddc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Creating volume 18a895f8-cffc-4444-a80d-64deb31d641e {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:36:55 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:36:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:55 devstack sudo[92480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e 1073741824
Jul 07 22:36:55 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:56 devstack sudo[92475]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD" returned: 0 in 0.868s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:56 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] 92445205-e8e3-4b89-b69d-7e05b2a64f9f was qcow2, converting to raw {{(pid=88077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:36:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:56 devstack sudo[92490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb
Jul 07 22:36:56 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:56 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e 1073741824" returned: 0 in 1.034s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:56 devstack sudo[92494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e
Jul 07 22:36:56 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:57 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e" returned: 0 in 0.936s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:36:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e9ad8d5-a02f-4a1a-b820-10c4aa4e1d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18a895f8-cffc-4444-a80d-64deb31d641e', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7f0253-fd2c-4aae-a13a-5075400a1437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:57 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Volume volume-18a895f8-cffc-4444-a80d-64deb31d641e (18a895f8-cffc-4444-a80d-64deb31d641e): created successfully
Jul 07 22:36:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7f0253-fd2c-4aae-a13a-5075400a1437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Flow 'volume_create_manager' (c4ce71b2-e4cd-4e03-9d3d-303574ccecd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:57 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6f9210e6-8a0f-4e9e-b3d5-c0cd5c795809 tempest-VolumesTransfersV355Test-1388054231 None] Created volume successfully.
Jul 07 22:36:58 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb" returned: 0 in 2.617s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:58 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_rp2owncudevstack@QuobyteHD, size 112.00 MB, duration 2.62 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:36:58 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Converted 112.00 MB image at 42.78 MB/s
Jul 07 22:36:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:58 devstack sudo[92526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb 1G
Jul 07 22:36:58 devstack sudo[92526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Acquiring lock "cinder-18a895f8-cffc-4444-a80d-64deb31d641e-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Lock "cinder-18a895f8-cffc-4444-a80d-64deb31d641e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Acquiring lock "cinder-quobyte-18a895f8-cffc-4444-a80d-64deb31d641e" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Lock "cinder-quobyte-18a895f8-cffc-4444-a80d-64deb31d641e" acquired by "delete_volume" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:59 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6ecd75-2760-42ff-9547-ddd84b2576b7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:59 devstack sudo[92529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e
Jul 07 22:36:59 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:59 devstack sudo[92526]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb 1G" returned: 0 in 0.960s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:59 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfa6d51-9250-4626-ab32-7f08c85d1cfb]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:59 devstack sudo[92535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb
Jul 07 22:36:59 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:00 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e" returned: 0 in 1.025s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:00 devstack sudo[92542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e
Jul 07 22:37:00 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:01 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb" returned: 0 in 1.172s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:01 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-18a895f8-cffc-4444-a80d-64deb31d641e" returned: 0 in 1.043s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Lock "cinder-quobyte-18a895f8-cffc-4444-a80d-64deb31d641e" released by "delete_volume" :: held 2.164s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:01 devstack sudo[92561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb
Jul 07 22:37:01 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Created reservations ['ac7edf86-752c-469b-a18b-3a95dadd31dc', '509766b2-5cbc-49b7-b06f-b6533d6474db', '0f97bc95-b59c-4ba1-9f3d-8d7e0efc5323', 'fccf0246-17c6-4743-9064-9235fc562b1e'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:01 devstack sudo[92573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:37:01 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:02 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb" returned: 1 in 1.204s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Downloaded image 92445205-e8e3-4b89-b69d-7e05b2a64f9f ((None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}])) to volume 5692a132-a723-4957-9e20-1d734bb5edfb successfully. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Temporary image 92445205-e8e3-4b89-b69d-7e05b2a64f9f for user 389c5d1b12e14388b4a7f2b08874b142 is deleted. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Marking volume 5692a132-a723-4957-9e20-1d734bb5edfb as bootable. {{(pid=88077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Copying metadata from image 92445205-e8e3-4b89-b69d-7e05b2a64f9f to 5692a132-a723-4957-9e20-1d734bb5edfb. {{(pid=88077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Creating volume glance metadata for volume 5692a132-a723-4957-9e20-1d734bb5edfb backed by image 92445205-e8e3-4b89-b69d-7e05b2a64f9f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6be06fc-08b4-424c-a8fc-f49b0239de0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5692a132-a723-4957-9e20-1d734bb5edfb', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72c3ed80>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fc84ee-280b-4fa4-b8ad-972b73d7dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:02 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Volume volume-5692a132-a723-4957-9e20-1d734bb5edfb (5692a132-a723-4957-9e20-1d734bb5edfb): created successfully
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1fc84ee-280b-4fa4-b8ad-972b73d7dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (bf477bda-c66d-4420-b0b0-476db220cb05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1cae6178-624e-4d7d-bc5e-baf02224ec26 tempest-VolumesGetTest-491551484 None] Created volume successfully.
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Flow 'volume_create_manager' (9dca4b34-7115-484a-8236-cb400d64cd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b9af65-21f8-48c2-9fe4-d21fc652aa7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b9af65-21f8-48c2-9fe4-d21fc652aa7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-887377767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c2e562-35ae-45ec-9a10-5439986a9b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f480c8ca4304bfebf1cec6b7a8c38da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:03Z,use_quota=True,user_id='7be3a00371a042c0850ce2175929dd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcb4266-168d-45a2-b69d-a863241f2838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bcb4266-168d-45a2-b69d-a863241f2838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50324cc1-2d1e-4b23-bf2b-081dc8397fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50324cc1-2d1e-4b23-bf2b-081dc8397fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c2e562-35ae-45ec-9a10-5439986a9b08', 'volume_name': 'volume-86c2e562-35ae-45ec-9a10-5439986a9b08', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1decc2f7-6b5f-4e7a-b991-56174f470e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1decc2f7-6b5f-4e7a-b991-56174f470e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d014dbc0-d352-4992-99a1-f087060e793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:02 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Volume 86c2e562-35ae-45ec-9a10-5439986a9b08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c2e562-35ae-45ec-9a10-5439986a9b08', 'volume_size': 1}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-887377767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86c2e562-35ae-45ec-9a10-5439986a9b08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f480c8ca4304bfebf1cec6b7a8c38da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:03Z,use_quota=True,user_id='7be3a00371a042c0850ce2175929dd76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Creating volume 86c2e562-35ae-45ec-9a10-5439986a9b08 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:02 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:37:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:02 devstack sudo[92579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08 1073741824
Jul 07 22:37:02 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:03 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.521s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:03 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:03 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Deleted volume successfully.
Jul 07 22:37:03 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3b581415-a51a-4f36-a629-8e795ebd0052 tempest-VolumesTransfersV355Test-596237262 None] Lock "cinder-18a895f8-cffc-4444-a80d-64deb31d641e-delete_volume" released by "delete_volume" :: held 4.136s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:04 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08 1073741824" returned: 0 in 1.396s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:04 devstack sudo[92587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08
Jul 07 22:37:04 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (b8b450a9-65de-4985-90c9-9840ab8c6862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83549d81-2a15-4d12-a5d8-0243ff41fc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83549d81-2a15-4d12-a5d8-0243ff41fc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1646282219',display_name='tempest-VolumesGetTest-Volume-1218082348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298b9c9c-2db8-4faa-846f-b7ec65b9455a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:05Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b482c608-d0a9-4f08-b386-dba266ca821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b482c608-d0a9-4f08-b386-dba266ca821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff945f3e-87ba-4728-9efe-a8cf53d19169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff945f3e-87ba-4728-9efe-a8cf53d19169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '298b9c9c-2db8-4faa-846f-b7ec65b9455a', 'volume_name': 'volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2c18e8-a247-4044-91d8-2d8376ddb582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2c18e8-a247-4044-91d8-2d8376ddb582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb81258c-5336-48c5-bb82-d7c333f62d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:04 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Volume 298b9c9c-2db8-4faa-846f-b7ec65b9455a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a', 'volume_size': 1}
Jul 07 22:37:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:05 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08" returned: 0 in 1.027s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] <== create_volume: return (2495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.497s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1646282219',display_name='tempest-VolumesGetTest-Volume-1218082348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=298b9c9c-2db8-4faa-846f-b7ec65b9455a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a455cdb31cdd4093a8f3d760fbb09c07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:05Z,use_quota=True,user_id='389c5d1b12e14388b4a7f2b08874b142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Creating volume 298b9c9c-2db8-4faa-846f-b7ec65b9455a {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:05 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:05 devstack sudo[92590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a 1073741824
Jul 07 22:37:05 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d014dbc0-d352-4992-99a1-f087060e793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c2e562-35ae-45ec-9a10-5439986a9b08', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f108a13-ba7f-453f-ba28-dd262a7d36c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:05 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Volume volume-86c2e562-35ae-45ec-9a10-5439986a9b08 (86c2e562-35ae-45ec-9a10-5439986a9b08): created successfully
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f108a13-ba7f-453f-ba28-dd262a7d36c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Flow 'volume_create_manager' (9dca4b34-7115-484a-8236-cb400d64cd35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:05 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-2700c064-6a66-4f58-baaf-323bf8a6ded8 tempest-AttachVolumeShelveTestJSON-931745951 None] Created volume successfully.
Jul 07 22:37:06 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a 1073741824" returned: 0 in 1.153s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:06 devstack sudo[92599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a
Jul 07 22:37:06 devstack sudo[92599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:07 devstack sudo[92599]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a" returned: 0 in 0.827s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb81258c-5336-48c5-bb82-d7c333f62d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a827f6f-3a81-4985-86f5-588fcd29fec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:07 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Volume volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a (298b9c9c-2db8-4faa-846f-b7ec65b9455a): created successfully
Jul 07 22:37:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a827f6f-3a81-4985-86f5-588fcd29fec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Flow 'volume_create_manager' (b8b450a9-65de-4985-90c9-9840ab8c6862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:07 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5972c12c-ce0c-484a-a1be-d0e2243c51f7 tempest-VolumesGetTest-491551484 None] Created volume successfully.
Jul 07 22:37:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-298b9c9c-2db8-4faa-846f-b7ec65b9455a-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Lock "cinder-298b9c9c-2db8-4faa-846f-b7ec65b9455a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-quobyte-298b9c9c-2db8-4faa-846f-b7ec65b9455a" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-298b9c9c-2db8-4faa-846f-b7ec65b9455a" acquired by "delete_volume" :: waited 0.032s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:08 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b88c9e-c485-4ee9-b902-cfd3eb8b11a9]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:08 devstack sudo[92638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a
Jul 07 22:37:08 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:09 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a" returned: 0 in 1.085s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:09 devstack sudo[92647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a
Jul 07 22:37:09 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:10 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-298b9c9c-2db8-4faa-846f-b7ec65b9455a" returned: 0 in 0.781s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-298b9c9c-2db8-4faa-846f-b7ec65b9455a" released by "delete_volume" :: held 1.927s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Created reservations ['f67cc764-5d80-4ad7-8f44-b51fdf903f80', '5100ee78-c38e-4898-9ec4-c6fee0a71228', 'b79708cb-494c-4628-9502-ad73e0e6aed2', 'b1f24efc-db01-47d7-8aa7-002ab7985065'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:10 devstack sudo[92656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:37:10 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Flow 'volume_create_manager' (67461a06-90ce-4df8-8498-3c4ab7f93689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea66186-773f-4b13-9590-614c87797d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ea66186-773f-4b13-9590-614c87797d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-306131585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59120a3-de71-44b9-8b1d-3d7385f3a51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f000c39d624e70981ecfcac862cc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:10Z,use_quota=True,user_id='6fcf6a40e8e6476eb85562e2f8ff6b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cdf4b8-39af-4344-85cf-6ef7df3551e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2cdf4b8-39af-4344-85cf-6ef7df3551e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ff4ae0-9002-4789-8aef-eba37a2b9b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ff4ae0-9002-4789-8aef-eba37a2b9b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e59120a3-de71-44b9-8b1d-3d7385f3a51d', 'volume_name': 'volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4660ef-6c49-4ea7-b252-d481c7046671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4660ef-6c49-4ea7-b252-d481c7046671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac485ec-5ab8-4821-a1f0-cbde85bc9761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:10 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Volume e59120a3-de71-44b9-8b1d-3d7385f3a51d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d', 'volume_size': 1}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-306131585',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e59120a3-de71-44b9-8b1d-3d7385f3a51d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f000c39d624e70981ecfcac862cc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:10Z,use_quota=True,user_id='6fcf6a40e8e6476eb85562e2f8ff6b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Creating volume e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:10 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:10 devstack sudo[92658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d 1073741824
Jul 07 22:37:10 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-5692a132-a723-4957-9e20-1d734bb5edfb-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Lock "cinder-5692a132-a723-4957-9e20-1d734bb5edfb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Acquiring lock "cinder-quobyte-5692a132-a723-4957-9e20-1d734bb5edfb" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-5692a132-a723-4957-9e20-1d734bb5edfb" acquired by "delete_volume" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[44da6589-8e55-48f3-ba24-9efdf805d990]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:11 devstack sudo[92683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb
Jul 07 22:37:11 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:11 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.915s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:11 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Deleted volume successfully.
Jul 07 22:37:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a91b1ce8-e0a6-4fc2-bb5a-37a08a1dff08 tempest-VolumesGetTest-491551484 None] Lock "cinder-298b9c9c-2db8-4faa-846f-b7ec65b9455a-delete_volume" released by "delete_volume" :: held 3.180s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:11 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d 1073741824" returned: 0 in 1.148s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:11 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb" returned: 0 in 0.940s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:11 devstack sudo[92698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d
Jul 07 22:37:11 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:12 devstack sudo[92699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb
Jul 07 22:37:12 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:12 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d" returned: 0 in 0.670s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ac485ec-5ab8-4821-a1f0-cbde85bc9761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7704b913-3d0b-4c1d-b3e5-95c4fca126c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:12 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Volume volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d (e59120a3-de71-44b9-8b1d-3d7385f3a51d): created successfully
Jul 07 22:37:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7704b913-3d0b-4c1d-b3e5-95c4fca126c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Flow 'volume_create_manager' (67461a06-90ce-4df8-8498-3c4ab7f93689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:12 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ad2a74b3-9337-4dd7-891f-57709b574bb9 tempest-VolumesCloneTest-163722466 None] Created volume successfully.
Jul 07 22:37:12 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb" returned: 1 in 0.881s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:37:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:12 devstack sudo[92707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb
Jul 07 22:37:12 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:13 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5692a132-a723-4957-9e20-1d734bb5edfb" returned: 0 in 0.711s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Lock "cinder-quobyte-5692a132-a723-4957-9e20-1d734bb5edfb" released by "delete_volume" :: held 2.685s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:13 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Created reservations ['a3cb1163-c31d-46ff-9428-993379775fe2', '98e130a9-01b3-406d-a386-f00f116b0dfd', 'cd74146b-1c63-496f-8e71-ce42af95b577', '5a7de3c8-e102-4038-a6ae-6154ecdb58af'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:13 devstack sudo[92710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:37:13 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Flow 'volume_create_manager' (fad108c0-7ad9-4962-a5c2-5fd37a25d1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deccfa12-ec07-40f5-9f7b-88e3471928bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deccfa12-ec07-40f5-9f7b-88e3471928bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-938564702',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06f000c39d624e70981ecfcac862cc63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=e59120a3-de71-44b9-8b1d-3d7385f3a51d,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:14Z,use_quota=True,user_id='6fcf6a40e8e6476eb85562e2f8ff6b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c1fc43-c2f0-4b97-bfd7-9293dd67bd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c1fc43-c2f0-4b97-bfd7-9293dd67bd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cf9670-30c2-4a7d-b975-c2379dfa5b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0cf9670-30c2-4a7d-b975-c2379dfa5b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4', 'volume_name': 'volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4', 'volume_size': 2, 'source_volid': 'e59120a3-de71-44b9-8b1d-3d7385f3a51d', 'source_volstatus': 'available'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:14 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0361d0f-8c34-498c-b9e1-21c43436b872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0361d0f-8c34-498c-b9e1-21c43436b872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68934666-8aac-45c0-af59-11d59cbdd499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:14 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Volume 5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4', 'volume_size': 2, 'source_volid': 'e59120a3-de71-44b9-8b1d-3d7385f3a51d', 'source_volstatus': 'available'}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.860s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:14 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Deleted volume successfully.
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:14 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Cloning volume e59120a3-de71-44b9-8b1d-3d7385f3a51d to volume 5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c8bd4c5b-4f15-4071-a47d-cf0516e6d7f4 tempest-VolumesGetTest-491551484 None] Lock "cinder-5692a132-a723-4957-9e20-1d734bb5edfb-delete_volume" released by "delete_volume" :: held 3.890s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Creating offline snapshot bafe50a9-e62e-4067-a25c-03ae0805a3d0 of volume e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4264000-198a-4994-9aea-7bc58eefbbec]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:14 devstack sudo[92713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d
Jul 07 22:37:14 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:15 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d" returned: 0 in 1.085s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:15 devstack sudo[92720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 1G
Jul 07 22:37:15 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:16 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 1G" returned: 0 in 0.986s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:16 devstack sudo[92726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0
Jul 07 22:37:16 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:17 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0" returned: 0 in 0.772s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:17 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 is being set with open permissions: ugo+rw
Jul 07 22:37:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:17 devstack sudo[92732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0
Jul 07 22:37:17 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:18 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0" returned: 0 in 0.716s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:18 devstack sudo[92735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.info
Jul 07 22:37:18 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:19 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.info" returned: 0 in 0.790s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:19 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.info is being set with open permissions: ugo+rw
Jul 07 22:37:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:19 devstack sudo[92739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.info
Jul 07 22:37:19 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:20 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.info" returned: 0 in 1.055s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Acquiring lock "cinder-quobyte-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Lock "cinder-quobyte-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] snapshot: bafe50a9-e62e-4067-a25c-03ae0805a3d0, volume: 5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8927930a-d29f-410d-8872-3eb37bdef11d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:20 devstack sudo[92747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0
Jul 07 22:37:20 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:21 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0" returned: 0 in 1.111s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:37:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:37:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:37:21 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d46955a-e418-4e1e-bbc1-1e8b374a8066]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:21 devstack sudo[92769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d
Jul 07 22:37:21 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Flow 'volume_create_manager' (aa7c5fdf-5c25-4128-8893-2b44c22e10b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07cf3952-6f0d-4140-a895-867345510faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07cf3952-6f0d-4140-a895-867345510faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1367605170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e4c29b-d9ef-45ea-9c86-32a0edf4c461,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbfc42f3215144688fc1547bae56bb08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:22Z,use_quota=True,user_id='398b28a2d0a34401929c9a0c4c10787e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6981f1-297c-4e0a-9678-f7f9046b41c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc6981f1-297c-4e0a-9678-f7f9046b41c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3e8efe-8549-4ec2-a42b-b9bb641f191d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a3e8efe-8549-4ec2-a42b-b9bb641f191d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57e4c29b-d9ef-45ea-9c86-32a0edf4c461', 'volume_name': 'volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ec4cb7-aa4c-4ace-bf5a-0751a2ec9625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06ec4cb7-aa4c-4ace-bf5a-0751a2ec9625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3f1279-5ef9-423e-83b8-643d12640c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:22 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Volume 57e4c29b-d9ef-45ea-9c86-32a0edf4c461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461', 'volume_size': 1}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:22 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d" returned: 0 in 1.095s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4 not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:37:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:22 devstack sudo[92776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4
Jul 07 22:37:22 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-7bc13468-a86b-4396-82b2-c0a12a1c545d req-f10ea939-02dc-466d-adf5-f8c9ec6a31bb tempest-AttachVolumeShelveTestJSON-931745951 None] No connector for attachment 581e50c9-017c-4723-8983-0b55d1e57969; skipping storage backend terminate_connection call. {{(pid=88077) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 07 22:37:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-7bc13468-a86b-4396-82b2-c0a12a1c545d req-f10ea939-02dc-466d-adf5-f8c9ec6a31bb tempest-AttachVolumeShelveTestJSON-931745951 None] Deleting attachment 581e50c9-017c-4723-8983-0b55d1e57969. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:37:27 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=101,cinder:SELECT=66,cinder:INSERT=29,cinder:DELETE=11 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:37:27 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=83,cinder:UPDATE=95,cinder:INSERT=28,cinder:DELETE=7 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:37:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-73bee90a-3139-41bb-8971-fc64cba1ed01 req-9d054836-4ff7-41cb-b8fa-d320e86201cb tempest-ServerActionsTestOtherA-13739957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:28 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4" returned: 0 in 5.937s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:28 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f3222d-636a-4734-a793-74b284016051]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:28 devstack sudo[92811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d
Jul 07 22:37:28 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:29 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d" returned: 0 in 1.013s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:29 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:37:29 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Converted 1024.00 MB image at 172.44 MB/s
Jul 07 22:37:29 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4 is being set with open permissions: ugo+rw
Jul 07 22:37:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:29 devstack sudo[92817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4
Jul 07 22:37:29 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:30 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4" returned: 0 in 0.637s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Lock "cinder-quobyte-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4" released by "_copy_volume_from_snapshot" :: held 9.900s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Acquiring lock "cinder-quobyte-bafe50a9-e62e-4067-a25c-03ae0805a3d0" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Lock "cinder-quobyte-bafe50a9-e62e-4067-a25c-03ae0805a3d0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Deleting offline snapshot bafe50a9-e62e-4067-a25c-03ae0805a3d0 of volume e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:37:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] snapshot_file for this snap is: volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:37:30 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a5a6e-d7dc-4f2a-bf1e-c61c65c98f02]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:30 devstack sudo[92821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0
Jul 07 22:37:30 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:30 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0" returned: 0 in 0.805s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:37:31 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe812b6a-5c62-4fa7-9189-d03d39329518]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:31 devstack sudo[92840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d
Jul 07 22:37:31 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:31 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d" returned: 0 in 0.784s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:31 devstack sudo[92845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0
Jul 07 22:37:31 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:32 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0" returned: 0 in 0.920s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:32 devstack sudo[92851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0
Jul 07 22:37:32 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:33 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d.bafe50a9-e62e-4067-a25c-03ae0805a3d0" returned: 0 in 0.679s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Lock "cinder-quobyte-bafe50a9-e62e-4067-a25c-03ae0805a3d0" released by "_delete_snapshot" :: held 3.311s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.924s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.194s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1367605170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e4c29b-d9ef-45ea-9c86-32a0edf4c461,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbfc42f3215144688fc1547bae56bb08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:22Z,use_quota=True,user_id='398b28a2d0a34401929c9a0c4c10787e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Creating volume 57e4c29b-d9ef-45ea-9c86-32a0edf4c461 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:33 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:33 devstack sudo[92854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461 1073741824
Jul 07 22:37:33 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68934666-8aac-45c0-af59-11d59cbdd499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4', 'volume_size': 2, 'source_volid': 'e59120a3-de71-44b9-8b1d-3d7385f3a51d', 'source_volstatus': 'available'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780a2287-a745-480d-93c0-70c533ca8a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Volume volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4 (5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4): created successfully
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (780a2287-a745-480d-93c0-70c533ca8a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Flow 'volume_create_manager' (fad108c0-7ad9-4962-a5c2-5fd37a25d1a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d0bde8ce-53d9-49bc-aeed-9b6251937383 tempest-VolumesCloneTest-163722466 None] Created volume successfully.
Jul 07 22:37:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Acquiring lock "cinder-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Lock "cinder-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Acquiring lock "cinder-quobyte-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Lock "cinder-quobyte-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4" acquired by "delete_volume" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:34 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d3b405-bd97-4e32-b0c3-1af36b87bd3d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:34 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461 1073741824" returned: 0 in 1.093s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:34 devstack sudo[92863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461
Jul 07 22:37:34 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:34 devstack sudo[92860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4
Jul 07 22:37:34 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:35 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461" returned: 0 in 0.767s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-73bee90a-3139-41bb-8971-fc64cba1ed01 req-9d054836-4ff7-41cb-b8fa-d320e86201cb tempest-ServerActionsTestOtherA-13739957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 8.114s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3f1279-5ef9-423e-83b8-643d12640c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40a9b17-3d23-43f9-916b-1ed58c2d8472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb078df8-f70d-4636-af63-37c6df7833fc]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-73bee90a-3139-41bb-8971-fc64cba1ed01 req-9d054836-4ff7-41cb-b8fa-d320e86201cb tempest-ServerActionsTestOtherA-13739957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:35 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Volume volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461 (57e4c29b-d9ef-45ea-9c86-32a0edf4c461): created successfully
Jul 07 22:37:35 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b40a9b17-3d23-43f9-916b-1ed58c2d8472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Flow 'volume_create_manager' (aa7c5fdf-5c25-4128-8893-2b44c22e10b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4" returned: 0 in 0.964s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:35 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-95c2b750-bfc8-425c-aef1-538d2a49fc84 tempest-VolumesListTestJSON-1024544334 None] Created volume successfully.
Jul 07 22:37:35 devstack sudo[92871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4
Jul 07 22:37:35 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:35 devstack sudo[92870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49
Jul 07 22:37:35 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:36 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4" returned: 0 in 0.693s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Lock "cinder-quobyte-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4" released by "delete_volume" :: held 1.710s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Created reservations ['f96a9fcd-6bbe-4fe6-83ef-906a5c5b1f67', '16ff5261-4d48-4c78-9af7-db2868d3fba2', '2a25456f-1cc8-4e3e-8666-7d0de4583df7', 'c341e4d8-a946-4b65-8947-636a17e76933'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:36 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-73bee90a-3139-41bb-8971-fc64cba1ed01 req-9d054836-4ff7-41cb-b8fa-d320e86201cb tempest-ServerActionsTestOtherA-13739957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49" returned: 0 in 0.915s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-73bee90a-3139-41bb-8971-fc64cba1ed01 req-9d054836-4ff7-41cb-b8fa-d320e86201cb tempest-ServerActionsTestOtherA-13739957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.949s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-73bee90a-3139-41bb-8971-fc64cba1ed01 req-9d054836-4ff7-41cb-b8fa-d320e86201cb tempest-ServerActionsTestOtherA-13739957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3c4bf2f-7a7e-4aee-877d-d3d2631a3baa', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:37:36 devstack sudo[92879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:37:36 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:36 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-73bee90a-3139-41bb-8971-fc64cba1ed01 req-9d054836-4ff7-41cb-b8fa-d320e86201cb tempest-ServerActionsTestOtherA-13739957 None] attachment_update completed successfully.
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Flow 'volume_create_manager' (25bb9999-bdc1-48f1-b3d3-ceffbdad46bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfba5796-4708-4af5-a467-8d7022cccf25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Acquiring lock "cinder-e59120a3-de71-44b9-8b1d-3d7385f3a51d-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfba5796-4708-4af5-a467-8d7022cccf25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1967607377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27eab14f-7523-4154-bd3b-d64a8f3f7379,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbfc42f3215144688fc1547bae56bb08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:37Z,use_quota=True,user_id='398b28a2d0a34401929c9a0c4c10787e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c7c8ba3-c1ff-42be-bd7c-76bea3df9681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c7c8ba3-c1ff-42be-bd7c-76bea3df9681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4aecd8-6acd-41f3-9cc7-5378132ff26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4aecd8-6acd-41f3-9cc7-5378132ff26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27eab14f-7523-4154-bd3b-d64a8f3f7379', 'volume_name': 'volume-27eab14f-7523-4154-bd3b-d64a8f3f7379', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9e8f08-c901-4bf6-8d33-5bdae188b3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9e8f08-c901-4bf6-8d33-5bdae188b3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d884ed4c-2591-4b85-8aa0-c2dec89e82dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:37 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Volume 27eab14f-7523-4154-bd3b-d64a8f3f7379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27eab14f-7523-4154-bd3b-d64a8f3f7379', 'volume_size': 1}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1967607377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27eab14f-7523-4154-bd3b-d64a8f3f7379,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbfc42f3215144688fc1547bae56bb08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:37Z,use_quota=True,user_id='398b28a2d0a34401929c9a0c4c10787e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Creating volume 27eab14f-7523-4154-bd3b-d64a8f3f7379 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:37 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Lock "cinder-e59120a3-de71-44b9-8b1d-3d7385f3a51d-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:37 devstack sudo[92947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379 1073741824
Jul 07 22:37:37 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Acquiring lock "cinder-quobyte-e59120a3-de71-44b9-8b1d-3d7385f3a51d" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Lock "cinder-quobyte-e59120a3-de71-44b9-8b1d-3d7385f3a51d" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:37 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.999s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Deleted volume successfully.
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[37870969-d281-4e58-925d-6aa97aedf9c0]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3e7192d2-1076-491f-adf0-8c1adabf0ae7 tempest-VolumesCloneTest-163722466 None] Lock "cinder-5574e42b-f8a3-4502-91d6-6bc2ff9fd9f4-delete_volume" released by "delete_volume" :: held 3.030s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:37 devstack sudo[92951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d
Jul 07 22:37:37 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:38 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d" returned: 0 in 1.063s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:38 devstack sudo[93275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d
Jul 07 22:37:38 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:38 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379 1073741824" returned: 0 in 1.417s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:38 devstack sudo[93277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379
Jul 07 22:37:38 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:39 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e59120a3-de71-44b9-8b1d-3d7385f3a51d" returned: 0 in 0.762s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Lock "cinder-quobyte-e59120a3-de71-44b9-8b1d-3d7385f3a51d" released by "delete_volume" :: held 1.923s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Created reservations ['820336a2-bcfb-42fb-858d-c139ffe36f10', 'bc2c99ea-972f-48bf-b052-087d03eeec28', 'f59cd392-0a24-47e7-bbff-609270d399aa', '790a0ba0-7402-4c32-955a-ab5b3bd94a46'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:39 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379" returned: 0 in 0.773s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.270s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d884ed4c-2591-4b85-8aa0-c2dec89e82dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27eab14f-7523-4154-bd3b-d64a8f3f7379', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d67c401-c68a-48f8-85e3-a99683a6c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:39 devstack sudo[93296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:37:39 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:39 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Volume volume-27eab14f-7523-4154-bd3b-d64a8f3f7379 (27eab14f-7523-4154-bd3b-d64a8f3f7379): created successfully
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d67c401-c68a-48f8-85e3-a99683a6c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Flow 'volume_create_manager' (25bb9999-bdc1-48f1-b3d3-ceffbdad46bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:39 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ed4c52f2-02de-4d78-bfb7-56b600448846 tempest-VolumesListTestJSON-1024544334 None] Created volume successfully.
Jul 07 22:37:40 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.764s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:40 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:40 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Deleted volume successfully.
Jul 07 22:37:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a3a2d79a-cabc-4a2c-95d0-646bfa28b8f1 tempest-VolumesCloneTest-163722466 None] Lock "cinder-e59120a3-de71-44b9-8b1d-3d7385f3a51d-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:40 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Flow 'volume_create_manager' (7f03a889-77d1-4b70-954b-8689b82401cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbd62e5-1633-4e0d-8068-3ec0f277b47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdbd62e5-1633-4e0d-8068-3ec0f277b47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1908896232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbfc42f3215144688fc1547bae56bb08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:41Z,use_quota=True,user_id='398b28a2d0a34401929c9a0c4c10787e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e38eeca-4a8a-4ac6-95c1-5794a0d8d13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e38eeca-4a8a-4ac6-95c1-5794a0d8d13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e399a8cf-c220-4567-9716-5ef02b8869e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e399a8cf-c220-4567-9716-5ef02b8869e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7', 'volume_name': 'volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b856fdb6-d792-46c7-ad3f-ca802b2095a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b856fdb6-d792-46c7-ad3f-ca802b2095a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593923d2-4745-4b2b-aa74-13ac48da138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:41 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Volume 63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7', 'volume_size': 1}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1908896232',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbfc42f3215144688fc1547bae56bb08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:41Z,use_quota=True,user_id='398b28a2d0a34401929c9a0c4c10787e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Creating volume 63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:41 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:37:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:41 devstack sudo[93321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7 1073741824
Jul 07 22:37:41 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:42 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7 1073741824" returned: 0 in 1.333s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:42 devstack sudo[93328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7
Jul 07 22:37:42 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:43 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7" returned: 0 in 0.850s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] <== create_volume: return (2269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593923d2-4745-4b2b-aa74-13ac48da138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cce79d-f8a2-4f67-99e2-7fbce01475f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:43 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Volume volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7 (63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7): created successfully
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3cce79d-f8a2-4f67-99e2-7fbce01475f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Flow 'volume_create_manager' (7f03a889-77d1-4b70-954b-8689b82401cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c05a87f4-5ce9-484f-b640-528f2274f634 tempest-VolumesListTestJSON-1024544334 None] Created volume successfully.
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:43 devstack sudo[93340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:37:43 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Flow 'volume_create_manager' (60b25314-6af6-48df-a76f-d317225dbe7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757b0bf8-5b96-4364-aac8-226dca320b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (757b0bf8-5b96-4364-aac8-226dca320b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-429330292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd033b60-3fd7-4a53-964c-0c4a8380f992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0544efa92f1a47499d9c1ce9e71f369c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:44Z,use_quota=True,user_id='54e194a4c4b5406ead0917b467a59fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e7921d-16a2-4c08-8db7-4152491195cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e7921d-16a2-4c08-8db7-4152491195cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7925c39a-5dea-45c6-8d56-d2bdd57d0e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7925c39a-5dea-45c6-8d56-d2bdd57d0e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd033b60-3fd7-4a53-964c-0c4a8380f992', 'volume_name': 'volume-dd033b60-3fd7-4a53-964c-0c4a8380f992', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ab90bc-b1a8-4570-aa61-42cb84f36774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ab90bc-b1a8-4570-aa61-42cb84f36774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682b06b3-ccf6-4f27-b029-8b74ba1fc583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:44 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Volume dd033b60-3fd7-4a53-964c-0c4a8380f992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd033b60-3fd7-4a53-964c-0c4a8380f992', 'volume_size': 1}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-429330292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd033b60-3fd7-4a53-964c-0c4a8380f992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0544efa92f1a47499d9c1ce9e71f369c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:44Z,use_quota=True,user_id='54e194a4c4b5406ead0917b467a59fd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Creating volume dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:44 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:44 devstack sudo[93375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 1073741824
Jul 07 22:37:44 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:44 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.369s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 28 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:37:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:37:45 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-9ed00f55-a87b-4917-9300-01dee9ae39f7 req-d09c17af-4d57-4600-864e-e8d1d7ab69c9 tempest-ServerActionsTestOtherA-13739957 None] Terminate volume connection completed successfully.
Jul 07 22:37:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-9ed00f55-a87b-4917-9300-01dee9ae39f7 req-d09c17af-4d57-4600-864e-e8d1d7ab69c9 tempest-ServerActionsTestOtherA-13739957 None] Deleting attachment a3c4bf2f-7a7e-4aee-877d-d3d2631a3baa. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:37:45 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 1073741824" returned: 0 in 1.399s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:45 devstack sudo[93448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992
Jul 07 22:37:45 devstack sudo[93448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:46 devstack sudo[93448]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992" returned: 0 in 0.873s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.354s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682b06b3-ccf6-4f27-b029-8b74ba1fc583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd033b60-3fd7-4a53-964c-0c4a8380f992', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0758c30-bb25-4eaf-9717-57ea20fa9e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:46 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Volume volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 (dd033b60-3fd7-4a53-964c-0c4a8380f992): created successfully
Jul 07 22:37:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0758c30-bb25-4eaf-9717-57ea20fa9e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Flow 'volume_create_manager' (60b25314-6af6-48df-a76f-d317225dbe7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:46 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-767db8a7-8c7b-4995-a8f1-4adb1f0d3de6 tempest-VolumesSnapshotListTestJSON-1875150643 None] Created volume successfully.
Jul 07 22:37:47 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "cinder-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:47 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "cinder-quobyte-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-quobyte-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7" acquired by "delete_volume" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:48 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea0b64-acce-4969-b92d-c56ae42dcc3b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Creating offline snapshot f255620e-8203-49b6-bf6b-870f3e741d63 of volume dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:37:48 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b294c58f-3846-4d53-af04-1123f813c30a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:48 devstack sudo[93476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992
Jul 07 22:37:48 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:48 devstack sudo[93475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7
Jul 07 22:37:48 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-9ed00f55-a87b-4917-9300-01dee9ae39f7 req-24d003e3-0ffe-4d0e-a2f9-f78c5adfc539 tempest-ServerActionsTestOtherA-13739957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:49 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7" returned: 0 in 1.321s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:49 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992" returned: 0 in 1.224s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:49 devstack sudo[93495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7
Jul 07 22:37:49 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:49 devstack sudo[93496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 1G
Jul 07 22:37:49 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:50 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7" returned: 0 in 0.848s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-quobyte-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7" released by "delete_volume" :: held 2.241s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Created reservations ['4f040e09-40d6-456c-9160-f63c35aa40b8', 'abbc6520-a3f6-4353-8fe2-72f383de88f9', '6b4c4640-b1de-4e09-a79a-2f168c846a8b', 'ff621829-d703-4292-8326-f3ecb648a821'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:50 devstack sudo[93505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:37:50 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:50 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 1G" returned: 0 in 1.127s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:50 devstack sudo[93507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63
Jul 07 22:37:50 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:51 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "cinder-27eab14f-7523-4154-bd3b-d64a8f3f7379-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.168s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:51 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:51 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Deleted volume successfully.
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63" returned: 0 in 1.129s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:51 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 is being set with open permissions: ugo+rw
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-27eab14f-7523-4154-bd3b-d64a8f3f7379-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:51 devstack sudo[93515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63
Jul 07 22:37:51 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2e1d6eea-c23f-4d85-8eae-3d7d601b31e9 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-63d7b2b3-0bd3-4824-80fa-7712fa2e5bd7-delete_volume" released by "delete_volume" :: held 3.888s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "cinder-quobyte-27eab14f-7523-4154-bd3b-d64a8f3f7379" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-quobyte-27eab14f-7523-4154-bd3b-d64a8f3f7379" acquired by "delete_volume" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[31254ff9-489d-4223-9e40-35a546b8b691]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:52 devstack sudo[93517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379
Jul 07 22:37:52 devstack sudo[93517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:52 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63" returned: 0 in 0.954s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:52 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.info
Jul 07 22:37:52 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:53 devstack sudo[93517]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379" returned: 0 in 1.405s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:53 devstack sudo[93526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379
Jul 07 22:37:53 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:53 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.info" returned: 0 in 0.984s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:53 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.info is being set with open permissions: ugo+rw
Jul 07 22:37:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:53 devstack sudo[93529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.info
Jul 07 22:37:53 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:54 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-27eab14f-7523-4154-bd3b-d64a8f3f7379" returned: 0 in 0.821s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-quobyte-27eab14f-7523-4154-bd3b-d64a8f3f7379" released by "delete_volume" :: held 2.273s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Created reservations ['fd21ee03-d1ba-447f-b1da-5444eb5076f8', '0112cb4e-c6ea-40d8-972f-6548b7131354', '6da2a366-caf2-44f2-bb9f-2b508e4f91f9', '24064932-724c-4e2f-a000-4582ca3d18db'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:54 devstack sudo[93532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:37:54 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:54 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.info" returned: 0 in 0.794s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.456s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-9ed00f55-a87b-4917-9300-01dee9ae39f7 req-24d003e3-0ffe-4d0e-a2f9-f78c5adfc539 tempest-ServerActionsTestOtherA-13739957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.854s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33f7b45-af70-4d2d-a2c4-7e3f2dcbbcc7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-9ed00f55-a87b-4917-9300-01dee9ae39f7 req-24d003e3-0ffe-4d0e-a2f9-f78c5adfc539 tempest-ServerActionsTestOtherA-13739957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:54 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9a7208b7-e717-4e64-bb63-565364034b7b tempest-VolumesSnapshotListTestJSON-1875150643 None] Create snapshot completed successfully
Jul 07 22:37:54 devstack sudo[93535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49
Jul 07 22:37:54 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "cinder-57e4c29b-d9ef-45ea-9c86-32a0edf4c461-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:55 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.884s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-57e4c29b-d9ef-45ea-9c86-32a0edf4c461-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Deleted volume successfully.
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "cinder-quobyte-57e4c29b-d9ef-45ea-9c86-32a0edf4c461" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e33b6a29-6b31-4206-90b9-c1e612b6eb46 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-27eab14f-7523-4154-bd3b-d64a8f3f7379-delete_volume" released by "delete_volume" :: held 3.506s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-quobyte-57e4c29b-d9ef-45ea-9c86-32a0edf4c461" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8e5db1-a535-4e20-9832-0c90bd205f2c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:55 devstack sudo[93538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461
Jul 07 22:37:55 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:55 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-9ed00f55-a87b-4917-9300-01dee9ae39f7 req-24d003e3-0ffe-4d0e-a2f9-f78c5adfc539 tempest-ServerActionsTestOtherA-13739957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49" returned: 0 in 1.035s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-9ed00f55-a87b-4917-9300-01dee9ae39f7 req-24d003e3-0ffe-4d0e-a2f9-f78c5adfc539 tempest-ServerActionsTestOtherA-13739957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.057s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-9ed00f55-a87b-4917-9300-01dee9ae39f7 req-24d003e3-0ffe-4d0e-a2f9-f78c5adfc539 tempest-ServerActionsTestOtherA-13739957 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b9a26952-78c0-4401-895c-18df60b8033c', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:37:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-9ed00f55-a87b-4917-9300-01dee9ae39f7 req-24d003e3-0ffe-4d0e-a2f9-f78c5adfc539 tempest-ServerActionsTestOtherA-13739957 None] attachment_update completed successfully.
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] Creating offline snapshot 11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 of volume dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f377dd-4b2d-491d-9d2d-7029c3800acd]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:56 devstack sudo[93543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63
Jul 07 22:37:56 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:56 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461" returned: 0 in 0.884s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:56 devstack sudo[93548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461
Jul 07 22:37:56 devstack sudo[93548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:56 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63" returned: 0 in 0.951s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd033b60-3fd7-4a53-964c-0c4a8380f992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:37:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:56 devstack sudo[93555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 1G
Jul 07 22:37:56 devstack sudo[93555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:57 devstack sudo[93548]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-57e4c29b-d9ef-45ea-9c86-32a0edf4c461" returned: 0 in 0.824s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-quobyte-57e4c29b-d9ef-45ea-9c86-32a0edf4c461" released by "delete_volume" :: held 1.780s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:57 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Created reservations ['f2fd570a-6b57-47ad-b4d5-4b020431b3a4', '3b5e1835-6887-4511-99d3-cfc7b30a1ffc', 'e9b3323b-8f70-4c60-a457-97d8b55b01e4', '85c4ff9b-4fa6-439e-9c85-a016a5d99c34'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:57 devstack sudo[93557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:37:57 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:58 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.941s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:58 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:58 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Deleted volume successfully.
Jul 07 22:37:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-90918013-74a6-4cfe-a78d-c78bc065b4b9 tempest-VolumesListTestJSON-1024544334 None] Lock "cinder-57e4c29b-d9ef-45ea-9c86-32a0edf4c461-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:58 devstack sudo[93555]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 1G" returned: 0 in 1.253s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:58 devstack sudo[93565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4
Jul 07 22:37:58 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:59 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4" returned: 0 in 0.984s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:59 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 is being set with open permissions: ugo+rw
Jul 07 22:37:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:59 devstack sudo[93584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4
Jul 07 22:37:59 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:00 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4" returned: 0 in 0.842s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.144s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-58457cb2-0bb3-4799-9da1-7f655583e2b0 tempest-VolumesSnapshotListTestJSON-1875150643 None] Create snapshot completed successfully
Jul 07 22:38:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] Creating offline snapshot 1bac63c4-b3a0-43b5-85e7-f29fabbf363e of volume dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:38:00 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2d3abc-81ca-4c4b-b49b-450ef96cd5bf]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:00 devstack sudo[93674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4
Jul 07 22:38:00 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:01 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4" returned: 0 in 1.002s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd033b60-3fd7-4a53-964c-0c4a8380f992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:01 devstack sudo[93697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e 1G
Jul 07 22:38:01 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:02 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e 1G" returned: 0 in 1.250s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:02 devstack sudo[94038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e
Jul 07 22:38:02 devstack sudo[94038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:03 devstack sudo[94038]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e" returned: 0 in 0.882s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:03 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e is being set with open permissions: ugo+rw
Jul 07 22:38:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:03 devstack sudo[94046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e
Jul 07 22:38:03 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:04 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e" returned: 0 in 0.694s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.028s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4b63ed7b-36f6-4937-bcdd-10baacbf27e9 tempest-VolumesSnapshotListTestJSON-1875150643 None] Create snapshot completed successfully
Jul 07 22:38:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-1bac63c4-b3a0-43b5-85e7-f29fabbf363e-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-1bac63c4-b3a0-43b5-85e7-f29fabbf363e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" acquired by "delete_snapshot" :: waited 0.055s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-quobyte-1bac63c4-b3a0-43b5-85e7-f29fabbf363e" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-1bac63c4-b3a0-43b5-85e7-f29fabbf363e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Deleting offline snapshot 1bac63c4-b3a0-43b5-85e7-f29fabbf363e of volume dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:38:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] snapshot_file for this snap is: volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:38:06 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f35d6d7-bc92-433b-997c-2d102b7eeea8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:06 devstack sudo[94049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e
Jul 07 22:38:06 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:07 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e" returned: 0 in 1.134s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd033b60-3fd7-4a53-964c-0c4a8380f992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:07 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac90cda9-7b35-42f7-a6a5-9d77343f7217]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:07 devstack sudo[94054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4
Jul 07 22:38:07 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:08 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4" returned: 0 in 1.204s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd033b60-3fd7-4a53-964c-0c4a8380f992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:08 devstack sudo[94062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e
Jul 07 22:38:08 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:10 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e" returned: 0 in 1.328s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:10 devstack sudo[94106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e
Jul 07 22:38:10 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:10 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.1bac63c4-b3a0-43b5-85e7-f29fabbf363e" returned: 0 in 0.855s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-1bac63c4-b3a0-43b5-85e7-f29fabbf363e" released by "_delete_snapshot" :: held 4.740s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" released by "delete_snapshot" :: held 4.781s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Created reservations ['56e238fa-d45d-4179-92a8-eb026eb54e26', 'b30ec620-dfab-488d-b8fb-61bc9bac5338', '71f2b54a-5225-413b-9283-873631b070fc', '0b73260f-8f77-480c-bf5a-3be974c17417'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Delete snapshot completed successfully.
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8fd5cd17-f976-4e3a-b66f-b86cf86ab48e tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-1bac63c4-b3a0-43b5-85e7-f29fabbf363e-delete_snapshot" released by "delete_snapshot" :: held 5.005s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-11193196-cc3e-4cbe-a0f7-c56f6d1e91f4-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-11193196-cc3e-4cbe-a0f7-c56f6d1e91f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-quobyte-11193196-cc3e-4cbe-a0f7-c56f6d1e91f4" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-11193196-cc3e-4cbe-a0f7-c56f6d1e91f4" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Deleting offline snapshot 11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 of volume dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] snapshot_file for this snap is: volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f8c192-ceb0-43a8-a437-559507f4d61e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:11 devstack sudo[94129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4
Jul 07 22:38:11 devstack sudo[94129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:12 devstack sudo[94129]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4" returned: 0 in 1.114s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd033b60-3fd7-4a53-964c-0c4a8380f992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:12 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa52783-7789-406f-97e9-c1addc544cfa]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:13 devstack sudo[94138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63
Jul 07 22:38:13 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:14 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63" returned: 0 in 1.397s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd033b60-3fd7-4a53-964c-0c4a8380f992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:14 devstack sudo[94147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4
Jul 07 22:38:14 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:15 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4" returned: 0 in 1.024s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:15 devstack sudo[94152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4
Jul 07 22:38:15 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:16 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.11193196-cc3e-4cbe-a0f7-c56f6d1e91f4" returned: 0 in 0.806s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-11193196-cc3e-4cbe-a0f7-c56f6d1e91f4" released by "_delete_snapshot" :: held 4.480s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" released by "delete_snapshot" :: held 4.511s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:16 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Created reservations ['e7b04575-63e3-4f25-942d-157e873caf47', '0a4f1eba-daf7-4baa-aea4-7244974f43c4', 'f61a4bdd-7d8a-495e-b919-73bb67aca976', 'fe71a4df-bb79-4b3d-9d52-04acc232f36b'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Delete snapshot completed successfully.
Jul 07 22:38:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5e30f470-eb08-4154-a39e-64919a109622 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-11193196-cc3e-4cbe-a0f7-c56f6d1e91f4-delete_snapshot" released by "delete_snapshot" :: held 4.722s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-f255620e-8203-49b6-bf6b-870f3e741d63-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-f255620e-8203-49b6-bf6b-870f3e741d63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-quobyte-f255620e-8203-49b6-bf6b-870f3e741d63" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-f255620e-8203-49b6-bf6b-870f3e741d63" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Deleting offline snapshot f255620e-8203-49b6-bf6b-870f3e741d63 of volume dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:38:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] snapshot_file for this snap is: volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:38:17 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[037df2d2-9391-4c31-81f8-2275ceefc586]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:17 devstack sudo[94180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63
Jul 07 22:38:17 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:18 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63" returned: 0 in 0.989s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd033b60-3fd7-4a53-964c-0c4a8380f992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:18 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f407f03-a72c-4fdf-a59e-16a97f395124]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:18 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992
Jul 07 22:38:18 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Acquiring lock "cinder-86c2e562-35ae-45ec-9a10-5439986a9b08-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Lock "cinder-86c2e562-35ae-45ec-9a10-5439986a9b08-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Acquiring lock "cinder-quobyte-86c2e562-35ae-45ec-9a10-5439986a9b08" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Lock "cinder-quobyte-86c2e562-35ae-45ec-9a10-5439986a9b08" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:18 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7cbea4-2db6-452b-8d6e-79f4c7f5fa0b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:19 devstack sudo[94191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08
Jul 07 22:38:19 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:19 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992" returned: 0 in 0.934s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:19 devstack sudo[94193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63
Jul 07 22:38:19 devstack sudo[94193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:19 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08" returned: 0 in 0.940s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:19 devstack sudo[94227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08
Jul 07 22:38:19 devstack sudo[94227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:20 devstack sudo[94193]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63" returned: 0 in 0.932s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:20 devstack sudo[94230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63
Jul 07 22:38:20 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:20 devstack sudo[94227]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86c2e562-35ae-45ec-9a10-5439986a9b08" returned: 0 in 0.745s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Lock "cinder-quobyte-86c2e562-35ae-45ec-9a10-5439986a9b08" released by "delete_volume" :: held 1.737s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Created reservations ['85fb4c62-b772-4bdd-802c-3e6b8c4af5c8', '92d5def8-8115-4bb3-92b1-659b7f1751a9', '52ad13e9-ad95-4832-85aa-e36db1b4d4e4', 'c4233c62-bd28-4a4f-af7d-1e40347d5c10'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:20 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992.f255620e-8203-49b6-bf6b-870f3e741d63" returned: 0 in 0.706s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:20 devstack sudo[94234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:38:20 devstack sudo[94234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-f255620e-8203-49b6-bf6b-870f3e741d63" released by "_delete_snapshot" :: held 3.708s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" released by "delete_snapshot" :: held 3.732s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Created reservations ['9afe0fd3-2d4e-4757-b7bf-0c82d037d863', '9705bdd1-7765-4d5d-9a08-f126535683ff', 'b41b4c7b-f0e8-46d4-9ae5-f635cb55c79f', 'e3274cf5-7574-48b4-9c7b-9253748fc621'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:20 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Delete snapshot completed successfully.
Jul 07 22:38:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8bdb23e9-079c-4950-8ed7-ef1ffd55e063 tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-f255620e-8203-49b6-bf6b-870f3e741d63-delete_snapshot" released by "delete_snapshot" :: held 3.888s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-dd033b60-3fd7-4a53-964c-0c4a8380f992-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-dd033b60-3fd7-4a53-964c-0c4a8380f992-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:21 devstack sudo[94234]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.763s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:21 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:21 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Deleted volume successfully.
Jul 07 22:38:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" acquired by "delete_volume" :: waited 0.040s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-59723e7a-fcc1-44a6-b32f-48b919ed4990 tempest-AttachVolumeShelveTestJSON-931745951 None] Lock "cinder-86c2e562-35ae-45ec-9a10-5439986a9b08-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:21 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3ea99f-803d-40ce-9a22-795c2f846701]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:21 devstack sudo[94237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992
Jul 07 22:38:21 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:22 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992" returned: 0 in 1.007s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:22 devstack sudo[94242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992
Jul 07 22:38:22 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:23 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dd033b60-3fd7-4a53-964c-0c4a8380f992" returned: 0 in 0.858s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-quobyte-dd033b60-3fd7-4a53-964c-0c4a8380f992" released by "delete_volume" :: held 1.959s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:23 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Created reservations ['f44a84e3-86da-4765-8e2f-e94785877c88', 'fe679d41-02fd-47d9-b15e-1f7d99caf7ea', 'f1a0ff50-cae6-4255-af45-d5073d094006', 'ef3db760-d240-4019-92d3-fe66af5f0c3c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:23 devstack sudo[94247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:38:23 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:24 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.868s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:24 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:24 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Deleted volume successfully.
Jul 07 22:38:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f467d3ee-cf41-48ed-ad76-cc5e417d870a tempest-VolumesSnapshotListTestJSON-1875150643 None] Lock "cinder-dd033b60-3fd7-4a53-964c-0c4a8380f992-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:32 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=103,cinder:SELECT=70,cinder:INSERT=27,cinder:DELETE=8 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:38:32 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=86,cinder:SELECT=85,cinder:DELETE=7,cinder:INSERT=19 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:38:32 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:38:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Flow 'volume_create_manager' (66807a60-af74-4543-b472-17c1a15a238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa530ed8-bee7-4cac-8452-5b164bb910f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa530ed8-bee7-4cac-8452-5b164bb910f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1601845165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80299523b94f4664bcc96977621b08d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:33Z,use_quota=True,user_id='de671850d125439abfae97256d9ba4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba9319f-df88-4a10-8b04-45ec88ba11a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba9319f-df88-4a10-8b04-45ec88ba11a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cc3c36-812c-49e3-9404-4c0d8fb46da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:32 devstack cinder-volume[88077]: DEBUG cinder.image.glance [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Creating Keystone auth plugin from conf {{(pid=88077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:38:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cc3c36-812c-49e3-9404-4c0d8fb46da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9', 'volume_name': 'volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72e08320>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbbd9c0-a6f4-4eb2-9a4c-ada3c20b152b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abbbd9c0-a6f4-4eb2-9a4c-ada3c20b152b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90bd1c4-14d9-4cc4-bce7-fd3905ca9a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Volume 9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72e08320>}
Jul 07 22:38:33 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Trying to clone 9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 from image 92445205-e8e3-4b89-b69d-7e05b2a64f9f at location (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]). {{(pid=88077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:38:33 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:38:33 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 22:38:33 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e766fa-1f6c-467c-8db5-8f3620c7cfa3]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-5b3cbb6a-5585-46a7-8a93-d2f0f39ca4f6 req-9543edff-2359-4bf8-9833-7203ef74d942 tempest-ServerActionsTestOtherA-13739957 None] Terminate volume connection completed successfully.
Jul 07 22:38:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-5b3cbb6a-5585-46a7-8a93-d2f0f39ca4f6 req-9543edff-2359-4bf8-9833-7203ef74d942 tempest-ServerActionsTestOtherA-13739957 None] Deleting attachment b9a26952-78c0-4401-895c-18df60b8033c. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:38:33 devstack sudo[94259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD
Jul 07 22:38:33 devstack sudo[94259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:34 devstack sudo[94259]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD" returned: 0 in 0.916s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:34 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Temporary image 92445205-e8e3-4b89-b69d-7e05b2a64f9f is fetched for user de671850d125439abfae97256d9ba4b1. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:38:34 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[18db39d6-fff4-4836-ad06-00342b9d0f38]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:35 devstack sudo[94266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD
Jul 07 22:38:35 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:35 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD" returned: 0 in 0.925s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1601845165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80299523b94f4664bcc96977621b08d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:33Z,use_quota=True,user_id='de671850d125439abfae97256d9ba4b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Creating volume 9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:38:35 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:38:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:35 devstack sudo[94271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 1073741824
Jul 07 22:38:35 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:36 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 1073741824" returned: 0 in 1.016s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:36 devstack sudo[94277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:38:36 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3f728013-95cc-41d1-a666-80e015b9a96d tempest-GroupSnapshotsV319Test-2020299463 None] Group tempest-GroupSnapshotsV319Test-Group-567725014: creating
Jul 07 22:38:37 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 0 in 1.015s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:38:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3f728013-95cc-41d1-a666-80e015b9a96d tempest-GroupSnapshotsV319Test-2020299463 None] Group tempest-GroupSnapshotsV319Test-Group-567725014: created successfully
Jul 07 22:38:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3f728013-95cc-41d1-a666-80e015b9a96d tempest-GroupSnapshotsV319Test-2020299463 None] Create group completed successfully.
Jul 07 22:38:37 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Attempting download of 92445205-e8e3-4b89-b69d-7e05b2a64f9f ((None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}])) to volume 9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:38:38 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee76ce2-1dde-414c-8a26-23c026e563c6]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_eofa13hy {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:38 devstack sudo[94298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_eofa13hy
Jul 07 22:38:38 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:38 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_eofa13hy" returned: 0 in 0.868s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_eofa13hy {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:39 devstack sudo[94308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_eofa13hy
Jul 07 22:38:39 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Flow 'volume_create_manager' (dd55d718-5553-4a6f-87ab-cc83390e6c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a8778c-1b32-4f7c-bb8d-2f0c9430e15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a8778c-1b32-4f7c-bb8d-2f0c9430e15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1603834429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=683d257c-0cd9-454f-9f19-870d0d3ff74d,host='devstack@QuobyteHD#QuobyteHD',id=98ce6057-66a2-4981-b31a-041d47239661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4df42b6e4594540911d19c776e29fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:40Z,use_quota=True,user_id='4553bc2e806845d482b5af9c090bf46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85fa3161-885f-46c0-b328-07a5f883a01b),volume_type_id=85fa3161-885f-46c0-b328-07a5f883a01b)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0863cc55-5359-4e08-a1e4-9f98150a13ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0863cc55-5359-4e08-a1e4-9f98150a13ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73722da8-391e-4fcf-a71c-95f20e38e82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73722da8-391e-4fcf-a71c-95f20e38e82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ce6057-66a2-4981-b31a-041d47239661', 'volume_name': 'volume-98ce6057-66a2-4981-b31a-041d47239661', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe72ad8-049d-4c62-8a38-3a0015a77f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe72ad8-049d-4c62-8a38-3a0015a77f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2dfe55d-2008-4b45-b701-7793a7b787c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:39 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Volume 98ce6057-66a2-4981-b31a-041d47239661: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ce6057-66a2-4981-b31a-041d47239661', 'volume_size': 1}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=683d257c-0cd9-454f-9f19-870d0d3ff74d,created_at=2026-07-07T20:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1603834429',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=683d257c-0cd9-454f-9f19-870d0d3ff74d,host='devstack@QuobyteHD#QuobyteHD',id=98ce6057-66a2-4981-b31a-041d47239661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4df42b6e4594540911d19c776e29fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:40Z,use_quota=True,user_id='4553bc2e806845d482b5af9c090bf46d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85fa3161-885f-46c0-b328-07a5f883a01b),volume_type_id=85fa3161-885f-46c0-b328-07a5f883a01b)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Creating volume 98ce6057-66a2-4981-b31a-041d47239661 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:38:39 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:38:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:39 devstack sudo[94314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661 1073741824
Jul 07 22:38:39 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:40 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_eofa13hy" returned: 1 in 1.144s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_eofa13hy' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:38:40 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[864dc791-ad94-48eb-8f89-9551e38bf731]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:40 devstack sudo[94316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD
Jul 07 22:38:40 devstack sudo[94316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:41 devstack sudo[94316]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD" returned: 0 in 1.111s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:41 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] 92445205-e8e3-4b89-b69d-7e05b2a64f9f was qcow2, converting to raw {{(pid=88077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:38:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:41 devstack sudo[94327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:38:41 devstack sudo[94327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:41 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661 1073741824" returned: 0 in 1.345s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:41 devstack sudo[94329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661
Jul 07 22:38:41 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:42 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661" returned: 0 in 0.915s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] <== create_volume: return (2323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:38:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2dfe55d-2008-4b45-b701-7793a7b787c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ce6057-66a2-4981-b31a-041d47239661', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d0c824-83d4-4c3e-b948-f7461cd4750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:42 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Volume volume-98ce6057-66a2-4981-b31a-041d47239661 (98ce6057-66a2-4981-b31a-041d47239661): created successfully
Jul 07 22:38:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d0c824-83d4-4c3e-b948-f7461cd4750e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Flow 'volume_create_manager' (dd55d718-5553-4a6f-87ab-cc83390e6c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:42 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b4eb4a6f-ffa3-4159-bd27-5bcd733b28ab tempest-GroupSnapshotsV319Test-2020299463 None] Created volume successfully.
Jul 07 22:38:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:38:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:43 devstack sudo[94344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:38:43 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:44 devstack sudo[94327]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:44 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] GroupSnapshot ed6bc3c5-aebc-4166-8fc6-a8d13bd8113f: creating.
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 0 in 2.870s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_iwwqa7lcdevstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:38:44 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Converted 112.00 MB image at 38.96 MB/s
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:44 devstack sudo[94346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 1G
Jul 07 22:38:44 devstack sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Group snapshot ed6bc3c5-aebc-4166-8fc6-a8d13bd8113f: creating. {{(pid=88077) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Creating offline snapshot f830d6ed-e5a7-4511-aca4-2992a1ae5b34 of volume 98ce6057-66a2-4981-b31a-041d47239661 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e41d22-758f-43f6-a83b-55f63ae93e13]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:44 devstack sudo[94348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661
Jul 07 22:38:44 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:44 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.912s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 28 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:38:44 devstack sudo[94346]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 1G" returned: 0 in 0.855s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:45 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17c4ae7-e64a-4e61-94d8-e8dc99f4e4b3]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:45 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:45 devstack sudo[94357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:38:45 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661" returned: 0 in 0.945s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:45 devstack sudo[94360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34 1G
Jul 07 22:38:45 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:45 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 0 in 0.912s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Acquiring lock "cinder-9a805c8a-6b59-491b-85bb-7d63c89b2b49-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:46 devstack sudo[94367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:38:46 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Lock "cinder-9a805c8a-6b59-491b-85bb-7d63c89b2b49-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:46 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34 1G" returned: 0 in 1.005s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98ce6057-66a2-4981-b31a-041d47239661 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Acquiring lock "cinder-quobyte-9a805c8a-6b59-491b-85bb-7d63c89b2b49" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Lock "cinder-quobyte-9a805c8a-6b59-491b-85bb-7d63c89b2b49" acquired by "delete_volume" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:46 devstack sudo[94369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98ce6057-66a2-4981-b31a-041d47239661 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34
Jul 07 22:38:46 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b882cae-2063-478f-9b89-1e0e8882fbb4]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:46 devstack sudo[94371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49
Jul 07 22:38:46 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:46 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 1 in 0.936s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Downloaded image 92445205-e8e3-4b89-b69d-7e05b2a64f9f ((None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}])) to volume 9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 successfully. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Temporary image 92445205-e8e3-4b89-b69d-7e05b2a64f9f for user de671850d125439abfae97256d9ba4b1 is deleted. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Marking volume 9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 as bootable. {{(pid=88077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Copying metadata from image 92445205-e8e3-4b89-b69d-7e05b2a64f9f to 9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9. {{(pid=88077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:38:46 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Creating volume glance metadata for volume 9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 backed by image 92445205-e8e3-4b89-b69d-7e05b2a64f9f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b90bd1c4-14d9-4cc4-bce7-fd3905ca9a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72e08320>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2c0cab-3f32-45ca-884d-aff172acd39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:47 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Volume volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 (9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9): created successfully
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2c0cab-3f32-45ca-884d-aff172acd39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Flow 'volume_create_manager' (66807a60-af74-4543-b472-17c1a15a238d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-049857f0-7a35-42b6-b09e-20f77698e2cb tempest-TestShelveInstance-550520810 None] Created volume successfully.
Jul 07 22:38:47 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98ce6057-66a2-4981-b31a-041d47239661 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34" returned: 0 in 0.987s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:47 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:47 devstack sudo[94382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34
Jul 07 22:38:47 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:47 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49" returned: 0 in 0.922s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:47 devstack sudo[94384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49
Jul 07 22:38:47 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:47 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9a805c8a-6b59-491b-85bb-7d63c89b2b49" returned: 0 in 0.716s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Lock "cinder-quobyte-9a805c8a-6b59-491b-85bb-7d63c89b2b49" released by "delete_volume" :: held 1.706s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:47 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34" returned: 0 in 0.813s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:48 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Created reservations ['f633be46-86a7-4ddb-9c57-1efe7df7c3c2', '4efacbd8-e165-4173-a55b-36fb26f00a46', '0a5521d1-24b6-4ed7-b6c9-5399124f8cb3', 'dd93c66a-e5b3-4728-a8a1-db201f37bd9f'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:48 devstack sudo[94388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.info
Jul 07 22:38:48 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:48 devstack sudo[94390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:38:48 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:48 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.info" returned: 0 in 0.834s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:48 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:38:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:48 devstack sudo[94394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.info
Jul 07 22:38:48 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:49 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.129s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:49 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:49 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Deleted volume successfully.
Jul 07 22:38:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c9425ff2-6217-43a4-92a7-0e2d11ffcce1 tempest-ServerActionsTestOtherA-13739957 None] Lock "cinder-9a805c8a-6b59-491b-85bb-7d63c89b2b49-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:49 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.info" returned: 0 in 0.939s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.651s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:50 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-fdf40c4b-b7d9-4aa7-bc12-1e8bdbc7b236 tempest-GroupSnapshotsV319Test-2020299463 None] group_snapshot ed6bc3c5-aebc-4166-8fc6-a8d13bd8113f: created successfully
Jul 07 22:38:51 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] group_snapshot ed6bc3c5-aebc-4166-8fc6-a8d13bd8113f: deleting
Jul 07 22:38:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] group_snapshot ed6bc3c5-aebc-4166-8fc6-a8d13bd8113f: deleting {{(pid=88077) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 22:38:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Acquiring lock "cinder-quobyte-98ce6057-66a2-4981-b31a-041d47239661" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Lock "cinder-quobyte-98ce6057-66a2-4981-b31a-041d47239661" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Acquiring lock "cinder-quobyte-f830d6ed-e5a7-4511-aca4-2992a1ae5b34" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Lock "cinder-quobyte-f830d6ed-e5a7-4511-aca4-2992a1ae5b34" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Deleting offline snapshot f830d6ed-e5a7-4511-aca4-2992a1ae5b34 of volume 98ce6057-66a2-4981-b31a-041d47239661 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:38:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] snapshot_file for this snap is: volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:38:51 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a3807f-3440-49c9-87cf-4dd7149a1417]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:51 devstack sudo[94423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34
Jul 07 22:38:51 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:52 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34" returned: 0 in 1.072s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98ce6057-66a2-4981-b31a-041d47239661(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:52 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b608f4f6-0802-4f54-8194-ce26f16e207c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:52 devstack sudo[94429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661
Jul 07 22:38:52 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:53 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661" returned: 0 in 0.929s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:53 devstack sudo[94436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34
Jul 07 22:38:53 devstack sudo[94436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:54 devstack sudo[94436]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34" returned: 0 in 1.134s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:54 devstack sudo[94444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34
Jul 07 22:38:54 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:55 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661.f830d6ed-e5a7-4511-aca4-2992a1ae5b34" returned: 0 in 0.898s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Lock "cinder-quobyte-f830d6ed-e5a7-4511-aca4-2992a1ae5b34" released by "_delete_snapshot" :: held 4.184s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Lock "cinder-quobyte-98ce6057-66a2-4981-b31a-041d47239661" released by "delete_snapshot" :: held 4.228s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:55 devstack cinder-volume[88077]: WARNING cinder.quota [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2037196213 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2037196213, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:38:55 devstack cinder-volume[88077]: WARNING cinder.quota [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2037196213 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2037196213, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:38:55 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] Created reservations ['daf9a806-3676-4277-aea6-35a498a69346', '9a685087-6d83-4461-b9d4-75f779c0ff47', 'a217d223-e5fe-4fbd-9a0e-8d943508082c', '5ade6b34-e7fe-425a-84c1-1e3a05c8afab'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3947eae2-659a-4e04-ade2-384b1cb19ce1 tempest-GroupSnapshotsV319Test-2020299463 None] group_snapshot ed6bc3c5-aebc-4166-8fc6-a8d13bd8113f: deleted successfully
Jul 07 22:38:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Acquiring lock "cinder-quobyte-98ce6057-66a2-4981-b31a-041d47239661" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Lock "cinder-quobyte-98ce6057-66a2-4981-b31a-041d47239661" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:57 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c543ef5b-de85-4250-b64a-e9d65d8149cd]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:57 devstack sudo[94449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661
Jul 07 22:38:57 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-13659ac3-4783-4412-9199-65fb564e915d req-6bfd5af2-8046-4571-942f-38f665da5bdd tempest-TestShelveInstance-550520810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-13659ac3-4783-4412-9199-65fb564e915d req-6bfd5af2-8046-4571-942f-38f665da5bdd tempest-TestShelveInstance-550520810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:57 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f510ea-4dfc-4e24-9eed-8ee3eb4e95f7]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-13659ac3-4783-4412-9199-65fb564e915d req-6bfd5af2-8046-4571-942f-38f665da5bdd tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:57 devstack sudo[94458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:38:57 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:58 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661" returned: 0 in 1.216s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:58 devstack sudo[94465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661
Jul 07 22:38:58 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:58 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-13659ac3-4783-4412-9199-65fb564e915d req-6bfd5af2-8046-4571-942f-38f665da5bdd tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 0 in 1.177s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-13659ac3-4783-4412-9199-65fb564e915d req-6bfd5af2-8046-4571-942f-38f665da5bdd tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:58 devstack sudo[94468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:38:58 devstack sudo[94468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:59 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-98ce6057-66a2-4981-b31a-041d47239661" returned: 0 in 0.929s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Lock "cinder-quobyte-98ce6057-66a2-4981-b31a-041d47239661" released by "delete_volume" :: held 2.240s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Created reservations ['a47b04d7-2414-4777-aaad-37243c9e0f9d'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:59 devstack cinder-volume[88077]: WARNING cinder.quota [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2037196213 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2037196213, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Created reservations ['68f62f1b-9fa9-4d9d-a76a-60711303248d', 'd1a3d5f2-e7e7-40cd-8b90-7efdc797fda1', '28ad3317-a8d2-4d18-be2e-424a0ea06d45', '57232a0e-dd47-4592-9bb3-7cde88664ef4'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:59 devstack sudo[94468]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-13659ac3-4783-4412-9199-65fb564e915d req-6bfd5af2-8046-4571-942f-38f665da5bdd tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 1 in 0.980s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-13659ac3-4783-4412-9199-65fb564e915d req-6bfd5af2-8046-4571-942f-38f665da5bdd tempest-TestShelveInstance-550520810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-13659ac3-4783-4412-9199-65fb564e915d req-6bfd5af2-8046-4571-942f-38f665da5bdd tempest-TestShelveInstance-550520810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.220s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-13659ac3-4783-4412-9199-65fb564e915d req-6bfd5af2-8046-4571-942f-38f665da5bdd tempest-TestShelveInstance-550520810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef9588b3-b7de-4cae-a13a-30c01268fce3', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:38:59 devstack sudo[94474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:38:59 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:59 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-13659ac3-4783-4412-9199-65fb564e915d req-6bfd5af2-8046-4571-942f-38f665da5bdd tempest-TestShelveInstance-550520810 None] attachment_update completed successfully.
Jul 07 22:39:00 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.018s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:00 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-15a1cbba-211f-4e3e-b5d2-5f3d9e4e4cba tempest-GroupSnapshotsV319Test-2020299463 None] Delete group completed successfully.
Jul 07 22:39:10 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4bdf5c82-a396-41e4-9900-a2a4eae683cb tempest-GroupsTest-1133621315 None] Group tempest-Group1-585276111: creating
Jul 07 22:39:10 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4bdf5c82-a396-41e4-9900-a2a4eae683cb tempest-GroupsTest-1133621315 None] Group tempest-Group1-585276111: created successfully
Jul 07 22:39:10 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4bdf5c82-a396-41e4-9900-a2a4eae683cb tempest-GroupsTest-1133621315 None] Create group completed successfully.
Jul 07 22:39:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-adc819a7-512c-4393-b0b0-e33729601055 tempest-GroupsTest-1133621315 None] Group tempest-Group2-543051317: creating
Jul 07 22:39:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-adc819a7-512c-4393-b0b0-e33729601055 tempest-GroupsTest-1133621315 None] Group tempest-Group2-543051317: created successfully
Jul 07 22:39:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-adc819a7-512c-4393-b0b0-e33729601055 tempest-GroupsTest-1133621315 None] Create group completed successfully.
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Flow 'volume_create_manager' (60d7e0d5-c9da-42e3-b4c4-2a138fa40394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253bc058-8afb-4496-b6b9-f05ca4c5c820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253bc058-8afb-4496-b6b9-f05ca4c5c820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1427039639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9d32b249-0b8c-4c2c-88c2-a02cf602610a,host='devstack@QuobyteHD#QuobyteHD',id=84984d74-a7fb-46c9-a7bf-0511746826fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01bc8e6fba846aa916dbd38a0718dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:14Z,use_quota=True,user_id='37270fdabf8d49b78deea6013f956f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ddf604b-5f81-45c6-b189-7732e74dfdef),volume_type_id=8ddf604b-5f81-45c6-b189-7732e74dfdef)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f471cd36-d7f7-4800-ac52-4db3c98a6b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f471cd36-d7f7-4800-ac52-4db3c98a6b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906d7dce-0707-4991-9b48-a9983cd9ca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906d7dce-0707-4991-9b48-a9983cd9ca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84984d74-a7fb-46c9-a7bf-0511746826fe', 'volume_name': 'volume-84984d74-a7fb-46c9-a7bf-0511746826fe', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f866c6c9-0630-4ee3-a581-4f2a5c9d89b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f866c6c9-0630-4ee3-a581-4f2a5c9d89b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f52e43-5a1a-4f53-b5d3-82709808b6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:14 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Volume 84984d74-a7fb-46c9-a7bf-0511746826fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84984d74-a7fb-46c9-a7bf-0511746826fe', 'volume_size': 1}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9d32b249-0b8c-4c2c-88c2-a02cf602610a,created_at=2026-07-07T20:39:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1427039639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9d32b249-0b8c-4c2c-88c2-a02cf602610a,host='devstack@QuobyteHD#QuobyteHD',id=84984d74-a7fb-46c9-a7bf-0511746826fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01bc8e6fba846aa916dbd38a0718dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:14Z,use_quota=True,user_id='37270fdabf8d49b78deea6013f956f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ddf604b-5f81-45c6-b189-7732e74dfdef),volume_type_id=8ddf604b-5f81-45c6-b189-7732e74dfdef)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Creating volume 84984d74-a7fb-46c9-a7bf-0511746826fe {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:39:14 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:39:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:14 devstack sudo[95000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe 1073741824
Jul 07 22:39:14 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:15 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe 1073741824" returned: 0 in 1.243s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:15 devstack sudo[95008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe
Jul 07 22:39:15 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:16 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe" returned: 0 in 0.960s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:39:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46f52e43-5a1a-4f53-b5d3-82709808b6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84984d74-a7fb-46c9-a7bf-0511746826fe', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27487b0f-a598-4242-9e50-12dde34254b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:16 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Volume volume-84984d74-a7fb-46c9-a7bf-0511746826fe (84984d74-a7fb-46c9-a7bf-0511746826fe): created successfully
Jul 07 22:39:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27487b0f-a598-4242-9e50-12dde34254b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Flow 'volume_create_manager' (60d7e0d5-c9da-42e3-b4c4-2a138fa40394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-cdc04637-09e1-4315-ba70-16cebb342d21 tempest-GroupsTest-1133621315 None] Created volume successfully.
Jul 07 22:39:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Acquiring lock "cinder-quobyte-84984d74-a7fb-46c9-a7bf-0511746826fe" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Lock "cinder-quobyte-84984d74-a7fb-46c9-a7bf-0511746826fe" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3815e6-1287-4af5-939a-68723c424111]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:19 devstack sudo[95013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe
Jul 07 22:39:19 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:21 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe" returned: 0 in 1.892s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:21 devstack sudo[95053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe
Jul 07 22:39:21 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:22 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-84984d74-a7fb-46c9-a7bf-0511746826fe" returned: 0 in 1.473s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Lock "cinder-quobyte-84984d74-a7fb-46c9-a7bf-0511746826fe" released by "delete_volume" :: held 3.492s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:22 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Created reservations ['1c2f68c4-add1-4482-a6f7-5b41c1c9e106'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:23 devstack cinder-volume[88077]: WARNING cinder.quota [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1532092273 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1532092273, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:39:23 devstack cinder-volume[88077]: WARNING cinder.quota [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1532092273 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1532092273, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:39:23 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Created reservations ['602596c4-ba94-4a2e-be85-5c4b8bb8ec80', '006b57a2-4a1a-47c4-8e8b-60dc21d4ab01', '90fbb039-ef7b-41d4-ba2d-a35ab79e0cc0', '554e367d-0ac2-4ec6-aaf6-895dd6b2f6fc'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:23 devstack sudo[95114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:39:23 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:24 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-34b16603-0b64-4bb7-989d-cf96f6448a53 tempest-GroupsTest-1133621315 None] Created reservations ['3acc46fc-7442-42fa-87ee-63cc19a86959'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-34b16603-0b64-4bb7-989d-cf96f6448a53 tempest-GroupsTest-1133621315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-34b16603-0b64-4bb7-989d-cf96f6448a53 tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-34b16603-0b64-4bb7-989d-cf96f6448a53 tempest-GroupsTest-1133621315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-34b16603-0b64-4bb7-989d-cf96f6448a53 tempest-GroupsTest-1133621315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-34b16603-0b64-4bb7-989d-cf96f6448a53 tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-34b16603-0b64-4bb7-989d-cf96f6448a53 tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:24 devstack sudo[95170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:39:24 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:24 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.313s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:24 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:24 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d0dc60c8-8aad-4f42-862a-17d4d227a4d9 tempest-GroupsTest-1133621315 None] Delete group completed successfully.
Jul 07 22:39:25 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-34b16603-0b64-4bb7-989d-cf96f6448a53 tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.263s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:25 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-34b16603-0b64-4bb7-989d-cf96f6448a53 tempest-GroupsTest-1133621315 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:25 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-34b16603-0b64-4bb7-989d-cf96f6448a53 tempest-GroupsTest-1133621315 None] Delete group completed successfully.
Jul 07 22:39:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0dc94aa1-0dd1-4a1c-8694-732a6870f50e tempest-GroupsTest-1133621315 None] Group tempest-GroupsTest-Group-802710553: creating
Jul 07 22:39:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0dc94aa1-0dd1-4a1c-8694-732a6870f50e tempest-GroupsTest-1133621315 None] Group tempest-GroupsTest-Group-802710553: created successfully
Jul 07 22:39:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0dc94aa1-0dd1-4a1c-8694-732a6870f50e tempest-GroupsTest-1133621315 None] Create group completed successfully.
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Flow 'volume_create_manager' (6e4e6bdb-a70c-46d3-8e3d-45331bcee9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6f5f48-30c0-41ef-b9a0-c4dee8a09268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f6f5f48-30c0-41ef-b9a0-c4dee8a09268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321087294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed041612-8e7b-4961-9fac-efdfc952f130,host='devstack@QuobyteHD#QuobyteHD',id=811b1124-57c8-4887-93ed-6fe036a1e74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01bc8e6fba846aa916dbd38a0718dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:29Z,use_quota=True,user_id='37270fdabf8d49b78deea6013f956f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f03a3b5-7e08-4467-9464-68d06e27268b),volume_type_id=6f03a3b5-7e08-4467-9464-68d06e27268b)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af09d8e7-0137-4d36-98f7-e6f47468edec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af09d8e7-0137-4d36-98f7-e6f47468edec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973f4ad0-df08-4e83-8314-e4d62925f68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (973f4ad0-df08-4e83-8314-e4d62925f68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '811b1124-57c8-4887-93ed-6fe036a1e74b', 'volume_name': 'volume-811b1124-57c8-4887-93ed-6fe036a1e74b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3eaec6f-2481-48f3-ae69-060dd9957c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3eaec6f-2481-48f3-ae69-060dd9957c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be48151-0158-444f-8a06-8425ac766cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:28 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Volume 811b1124-57c8-4887-93ed-6fe036a1e74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-811b1124-57c8-4887-93ed-6fe036a1e74b', 'volume_size': 1}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ed041612-8e7b-4961-9fac-efdfc952f130,created_at=2026-07-07T20:39:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-321087294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed041612-8e7b-4961-9fac-efdfc952f130,host='devstack@QuobyteHD#QuobyteHD',id=811b1124-57c8-4887-93ed-6fe036a1e74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01bc8e6fba846aa916dbd38a0718dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:29Z,use_quota=True,user_id='37270fdabf8d49b78deea6013f956f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f03a3b5-7e08-4467-9464-68d06e27268b),volume_type_id=6f03a3b5-7e08-4467-9464-68d06e27268b)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Creating volume 811b1124-57c8-4887-93ed-6fe036a1e74b {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:39:28 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:39:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:28 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b 1073741824
Jul 07 22:39:28 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Flow 'volume_create_manager' (81586485-c11a-4365-9a89-7a95d2e8f3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664038d8-9a8d-45e8-9a18-81ec30f2dca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664038d8-9a8d-45e8-9a18-81ec30f2dca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1342996392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08d662d-2e89-484f-a746-c8bfa856c94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582c43b68602498a87e38882bfb5d945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:29Z,use_quota=True,user_id='ea61df9877e9463dbbe5d977be06eced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08dbe55-1669-4ff0-b500-d58433dea78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e08dbe55-1669-4ff0-b500-d58433dea78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a7cb55-8a1f-4730-af07-442b25127940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a7cb55-8a1f-4730-af07-442b25127940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08d662d-2e89-484f-a746-c8bfa856c94c', 'volume_name': 'volume-a08d662d-2e89-484f-a746-c8bfa856c94c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf6aace-7f68-4d09-8b35-c55a545dcf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf6aace-7f68-4d09-8b35-c55a545dcf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de71b927-f24f-4e38-b61d-f5c8d41459d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:29 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Volume a08d662d-2e89-484f-a746-c8bfa856c94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08d662d-2e89-484f-a746-c8bfa856c94c', 'volume_size': 1}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:29 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b 1073741824" returned: 0 in 1.117s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:29 devstack sudo[95217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b
Jul 07 22:39:29 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:30 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b" returned: 0 in 0.815s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.164s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1342996392',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08d662d-2e89-484f-a746-c8bfa856c94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='582c43b68602498a87e38882bfb5d945',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:29Z,use_quota=True,user_id='ea61df9877e9463dbbe5d977be06eced',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Creating volume a08d662d-2e89-484f-a746-c8bfa856c94c {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:39:30 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be48151-0158-444f-8a06-8425ac766cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-811b1124-57c8-4887-93ed-6fe036a1e74b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420db8b8-ee23-4a0c-8c6a-859a7f77eeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:30 devstack sudo[95221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c 1073741824
Jul 07 22:39:30 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:30 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Volume volume-811b1124-57c8-4887-93ed-6fe036a1e74b (811b1124-57c8-4887-93ed-6fe036a1e74b): created successfully
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420db8b8-ee23-4a0c-8c6a-859a7f77eeba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Flow 'volume_create_manager' (6e4e6bdb-a70c-46d3-8e3d-45331bcee9fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:30 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-143e3418-eebe-4235-8c62-56168b1d7336 tempest-GroupsTest-1133621315 None] Created volume successfully.
Jul 07 22:39:32 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c 1073741824" returned: 0 in 1.451s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:39:32 devstack sudo[95227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c
Jul 07 22:39:32 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Flow 'volume_create_manager' (d1baf093-a6ec-4510-b39e-7d7a6e54cea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e881c014-8104-4183-a325-07d74d5484d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e881c014-8104-4183-a325-07d74d5484d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1074070581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed041612-8e7b-4961-9fac-efdfc952f130,host='devstack@QuobyteHD#QuobyteHD',id=cfa00ebb-fd4f-438e-aa3c-df2a67716be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01bc8e6fba846aa916dbd38a0718dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:32Z,use_quota=True,user_id='37270fdabf8d49b78deea6013f956f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f03a3b5-7e08-4467-9464-68d06e27268b),volume_type_id=6f03a3b5-7e08-4467-9464-68d06e27268b)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9d7050-7d53-4ac5-8319-214c18b138a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af9d7050-7d53-4ac5-8319-214c18b138a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f190524-219d-4949-964d-adaa7a6f3e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f190524-219d-4949-964d-adaa7a6f3e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa00ebb-fd4f-438e-aa3c-df2a67716be2', 'volume_name': 'volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c827ce7b-cbd2-4765-91a0-1ef8c96162e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c827ce7b-cbd2-4765-91a0-1ef8c96162e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c48670-898e-4451-a883-97b4612ef001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:32 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Volume cfa00ebb-fd4f-438e-aa3c-df2a67716be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2', 'volume_size': 1}
Jul 07 22:39:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:33 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c" returned: 0 in 0.864s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] <== create_volume: return (2398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ed041612-8e7b-4961-9fac-efdfc952f130,created_at=2026-07-07T20:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1074070581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ed041612-8e7b-4961-9fac-efdfc952f130,host='devstack@QuobyteHD#QuobyteHD',id=cfa00ebb-fd4f-438e-aa3c-df2a67716be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c01bc8e6fba846aa916dbd38a0718dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:32Z,use_quota=True,user_id='37270fdabf8d49b78deea6013f956f9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f03a3b5-7e08-4467-9464-68d06e27268b),volume_type_id=6f03a3b5-7e08-4467-9464-68d06e27268b)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Creating volume cfa00ebb-fd4f-438e-aa3c-df2a67716be2 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:39:33 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=68,cinder:INSERT=20,cinder:UPDATE=66,cinder:DELETE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de71b927-f24f-4e38-b61d-f5c8d41459d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08d662d-2e89-484f-a746-c8bfa856c94c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec15d15-8add-4c5a-8466-aecc1d0092f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:33 devstack sudo[95230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2 1073741824
Jul 07 22:39:33 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=73,cinder:INSERT=18,cinder:UPDATE=58,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:39:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Volume volume-a08d662d-2e89-484f-a746-c8bfa856c94c (a08d662d-2e89-484f-a746-c8bfa856c94c): created successfully
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec15d15-8add-4c5a-8466-aecc1d0092f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Flow 'volume_create_manager' (81586485-c11a-4365-9a89-7a95d2e8f3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-42807932-1e30-47f1-a7b2-e16951f42674 tempest-TestMinimumBasicScenario-1051033023 None] Created volume successfully.
Jul 07 22:39:34 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2 1073741824" returned: 0 in 1.483s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:34 devstack sudo[95244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2
Jul 07 22:39:34 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:35 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2" returned: 0 in 0.745s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] <== create_volume: return (2324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:39:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.327s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75c48670-898e-4451-a883-97b4612ef001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5cf007-e2ca-466a-9aec-a54fd070d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:35 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Volume volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2 (cfa00ebb-fd4f-438e-aa3c-df2a67716be2): created successfully
Jul 07 22:39:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5cf007-e2ca-466a-9aec-a54fd070d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Flow 'volume_create_manager' (d1baf093-a6ec-4510-b39e-7d7a6e54cea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:35 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6d091413-a563-4919-967c-e8851784804c tempest-GroupsTest-1133621315 None] Created volume successfully.
Jul 07 22:39:36 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-dd2fa096-e062-4901-b708-971e26059bad tempest-GroupsTest-1133621315 None] Update group completed successfully.
Jul 07 22:39:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-704686ce-8018-425c-ac72-d03c04ceec01 req-6e50198d-dbc2-484f-ae94-2003d3dac531 tempest-TestMinimumBasicScenario-1051033023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-704686ce-8018-425c-ac72-d03c04ceec01 req-6e50198d-dbc2-484f-ae94-2003d3dac531 tempest-TestMinimumBasicScenario-1051033023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:37 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25db034-322d-4356-a106-60df19d0cf16]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-704686ce-8018-425c-ac72-d03c04ceec01 req-6e50198d-dbc2-484f-ae94-2003d3dac531 tempest-TestMinimumBasicScenario-1051033023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:37 devstack sudo[95257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c
Jul 07 22:39:37 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:38 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a1206b07-c478-4642-8a43-a54f7773cae1 tempest-GroupsTest-1133621315 None] Update group completed successfully.
Jul 07 22:39:38 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-704686ce-8018-425c-ac72-d03c04ceec01 req-6e50198d-dbc2-484f-ae94-2003d3dac531 tempest-TestMinimumBasicScenario-1051033023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c" returned: 0 in 1.110s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-704686ce-8018-425c-ac72-d03c04ceec01 req-6e50198d-dbc2-484f-ae94-2003d3dac531 tempest-TestMinimumBasicScenario-1051033023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.129s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-704686ce-8018-425c-ac72-d03c04ceec01 req-6e50198d-dbc2-484f-ae94-2003d3dac531 tempest-TestMinimumBasicScenario-1051033023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-a08d662d-2e89-484f-a746-c8bfa856c94c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8dd7a153-a8d0-4b21-897d-4c845a4cbfbd', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:39:38 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-704686ce-8018-425c-ac72-d03c04ceec01 req-6e50198d-dbc2-484f-ae94-2003d3dac531 tempest-TestMinimumBasicScenario-1051033023 None] attachment_update completed successfully.
Jul 07 22:39:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Acquiring lock "cinder-quobyte-811b1124-57c8-4887-93ed-6fe036a1e74b" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Lock "cinder-quobyte-811b1124-57c8-4887-93ed-6fe036a1e74b" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:39 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09bb127-dcd5-46c7-b475-79fd4fb5b9ce]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:39 devstack sudo[95293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b
Jul 07 22:39:39 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:40 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b" returned: 0 in 1.089s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:40 devstack sudo[95303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b
Jul 07 22:39:40 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:41 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-811b1124-57c8-4887-93ed-6fe036a1e74b" returned: 0 in 0.947s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Lock "cinder-quobyte-811b1124-57c8-4887-93ed-6fe036a1e74b" released by "delete_volume" :: held 2.109s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Acquiring lock "cinder-quobyte-cfa00ebb-fd4f-438e-aa3c-df2a67716be2" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Lock "cinder-quobyte-cfa00ebb-fd4f-438e-aa3c-df2a67716be2" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:41 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d0906e-09db-4552-8868-13caa1547a60]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:41 devstack sudo[95323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2
Jul 07 22:39:41 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:42 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2" returned: 0 in 1.149s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:42 devstack sudo[95331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2
Jul 07 22:39:42 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:43 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfa00ebb-fd4f-438e-aa3c-df2a67716be2" returned: 0 in 0.851s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Lock "cinder-quobyte-cfa00ebb-fd4f-438e-aa3c-df2a67716be2" released by "delete_volume" :: held 2.067s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Created reservations ['11b3c55b-b198-43d0-b818-155c6c54e9a6'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:43 devstack cinder-volume[88077]: WARNING cinder.quota [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-78263740 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-78263740, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:39:43 devstack cinder-volume[88077]: WARNING cinder.quota [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-78263740 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-78263740, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Created reservations ['377117f3-044a-45ab-b2a8-ea5112226fba', '6139732e-2e6a-4a6f-81da-cb5e7119a98d', 'c7698ae8-f433-4e4a-ade2-1684d45eb882', '44d71c93-c856-4c70-bc36-298107e70c81'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:43 devstack sudo[95343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:39:43 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Created reservations ['d89ad61f-cda1-4731-b3d3-33659d58a436', '990ddcaa-5eab-4315-a587-aa67bb6dfcfa', '7d06d77d-ae55-4238-8993-c30b8ea6dfae', 'c8913d63-3be5-481d-8b43-2a1e0707f1cd'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:43 devstack sudo[95345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:39:43 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:44 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.295s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:39:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 28 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:39:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:39:45 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-634f6b0a-3cae-459a-b65c-3995cbb82ea6 req-741fab99-1633-468e-9872-982fcb9b8932 tempest-TestShelveInstance-550520810 None] Terminate volume connection completed successfully.
Jul 07 22:39:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-634f6b0a-3cae-459a-b65c-3995cbb82ea6 req-741fab99-1633-468e-9872-982fcb9b8932 tempest-TestShelveInstance-550520810 None] Deleting attachment ef9588b3-b7de-4cae-a13a-30c01268fce3. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:39:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.564s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:45 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:45 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-92101714-8bd7-45a7-b9d0-e4d015b5a86e tempest-GroupsTest-1133621315 None] Delete group completed successfully.
Jul 07 22:39:45 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-35bff2b9-419c-490f-aa3b-06cd5070e479 req-3fdb6643-f86a-4519-ae53-915372a2c8a8 tempest-TestShelveInstance-550520810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-35bff2b9-419c-490f-aa3b-06cd5070e479 req-3fdb6643-f86a-4519-ae53-915372a2c8a8 tempest-TestShelveInstance-550520810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:54 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b129a0a4-8a01-4c47-9c39-e91210dfacc3]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35bff2b9-419c-490f-aa3b-06cd5070e479 req-3fdb6643-f86a-4519-ae53-915372a2c8a8 tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:54 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-05f47913-a87c-421c-aeb5-db490fa46fce tempest-GroupsV314Test-511471201 None] Group tempest-GroupsV314Test-Group-594096294: creating
Jul 07 22:39:54 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-05f47913-a87c-421c-aeb5-db490fa46fce tempest-GroupsV314Test-511471201 None] Group tempest-GroupsV314Test-Group-594096294: created successfully
Jul 07 22:39:54 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-05f47913-a87c-421c-aeb5-db490fa46fce tempest-GroupsV314Test-511471201 None] Create group completed successfully.
Jul 07 22:39:55 devstack sudo[95455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:39:55 devstack sudo[95455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:56 devstack sudo[95455]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35bff2b9-419c-490f-aa3b-06cd5070e479 req-3fdb6643-f86a-4519-ae53-915372a2c8a8 tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 0 in 1.198s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35bff2b9-419c-490f-aa3b-06cd5070e479 req-3fdb6643-f86a-4519-ae53-915372a2c8a8 tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:56 devstack sudo[95460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:39:56 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Flow 'volume_create_manager' (3e124c29-3853-45d8-b8fd-2eccc59fcb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92085cbe-3ab3-490d-840d-8f8557868e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92085cbe-3ab3-490d-840d-8f8557868e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-897547039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8703753a-4267-400d-b036-ac7f93223262,host='devstack@QuobyteHD#QuobyteHD',id=a22b077d-ca40-4c83-8bdd-5a323720b85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c6c660f95c4db09ec0ac06870c82f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:57Z,use_quota=True,user_id='5f661b749b33478990ea784362e4a64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a66dac00-3020-45d9-8715-3892f3354490),volume_type_id=a66dac00-3020-45d9-8715-3892f3354490)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a4e21f-0544-4285-9f82-32821defbcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a4e21f-0544-4285-9f82-32821defbcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff4a7ad-c609-4c02-ad1a-8eba8ce23508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff4a7ad-c609-4c02-ad1a-8eba8ce23508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a22b077d-ca40-4c83-8bdd-5a323720b85d', 'volume_name': 'volume-a22b077d-ca40-4c83-8bdd-5a323720b85d', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b415ac-7add-4ef3-8c78-e12f288c16e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b415ac-7add-4ef3-8c78-e12f288c16e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69edc22-e3a2-4a4e-b5ce-9be07a9db21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:56 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Volume a22b077d-ca40-4c83-8bdd-5a323720b85d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a22b077d-ca40-4c83-8bdd-5a323720b85d', 'volume_size': 1}
Jul 07 22:39:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:57 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35bff2b9-419c-490f-aa3b-06cd5070e479 req-3fdb6643-f86a-4519-ae53-915372a2c8a8 tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 1 in 1.160s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-35bff2b9-419c-490f-aa3b-06cd5070e479 req-3fdb6643-f86a-4519-ae53-915372a2c8a8 tempest-TestShelveInstance-550520810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-35bff2b9-419c-490f-aa3b-06cd5070e479 req-3fdb6643-f86a-4519-ae53-915372a2c8a8 tempest-TestShelveInstance-550520810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.459s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.484s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8703753a-4267-400d-b036-ac7f93223262,created_at=2026-07-07T20:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-897547039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8703753a-4267-400d-b036-ac7f93223262,host='devstack@QuobyteHD#QuobyteHD',id=a22b077d-ca40-4c83-8bdd-5a323720b85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c6c660f95c4db09ec0ac06870c82f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:57Z,use_quota=True,user_id='5f661b749b33478990ea784362e4a64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a66dac00-3020-45d9-8715-3892f3354490),volume_type_id=a66dac00-3020-45d9-8715-3892f3354490)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Creating volume a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:39:57 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:57 devstack sudo[95465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d 1073741824
Jul 07 22:39:57 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-35bff2b9-419c-490f-aa3b-06cd5070e479 req-3fdb6643-f86a-4519-ae53-915372a2c8a8 tempest-TestShelveInstance-550520810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '410d05ae-ceb1-45dd-b2f4-198934854089', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:39:57 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-35bff2b9-419c-490f-aa3b-06cd5070e479 req-3fdb6643-f86a-4519-ae53-915372a2c8a8 tempest-TestShelveInstance-550520810 None] attachment_update completed successfully.
Jul 07 22:39:58 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d 1073741824" returned: 0 in 1.113s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:58 devstack sudo[95471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d
Jul 07 22:39:58 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:59 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d" returned: 0 in 0.798s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:39:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69edc22-e3a2-4a4e-b5ce-9be07a9db21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22b077d-ca40-4c83-8bdd-5a323720b85d', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af678f2-b868-4a85-9efb-8105ab79bc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:59 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Volume volume-a22b077d-ca40-4c83-8bdd-5a323720b85d (a22b077d-ca40-4c83-8bdd-5a323720b85d): created successfully
Jul 07 22:39:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af678f2-b868-4a85-9efb-8105ab79bc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Flow 'volume_create_manager' (3e124c29-3853-45d8-b8fd-2eccc59fcb61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:59 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6457e0cc-3528-4406-bf67-149edecfa1d8 tempest-GroupsV314Test-511471201 None] Created volume successfully.
Jul 07 22:40:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:01 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Cloning volume a22b077d-ca40-4c83-8bdd-5a323720b85d to volume 22ec4451-a5b0-46cd-a0a6-0fc142e1a293
Jul 07 22:40:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Creating offline snapshot d8c4e7f6-ca9b-4397-9e22-1794c6616f29 of volume a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:40:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c43cffe-a911-4fa3-852b-8282abb982d8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:02 devstack sudo[95504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d
Jul 07 22:40:02 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:03 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d" returned: 0 in 1.003s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:03 devstack sudo[95510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 1G
Jul 07 22:40:03 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:04 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 1G" returned: 0 in 1.104s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a22b077d-ca40-4c83-8bdd-5a323720b85d -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:04 devstack sudo[95535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a22b077d-ca40-4c83-8bdd-5a323720b85d -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29
Jul 07 22:40:04 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:04 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a22b077d-ca40-4c83-8bdd-5a323720b85d -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29" returned: 0 in 0.833s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:04 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:40:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:05 devstack sudo[95565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29
Jul 07 22:40:05 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:05 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29" returned: 0 in 0.773s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:05 devstack sudo[95568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.info
Jul 07 22:40:05 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:06 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.info" returned: 0 in 0.855s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:06 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:40:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:06 devstack sudo[95575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.info
Jul 07 22:40:06 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:07 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.info" returned: 0 in 1.021s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Acquiring lock "cinder-quobyte-22ec4451-a5b0-46cd-a0a6-0fc142e1a293" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Lock "cinder-quobyte-22ec4451-a5b0-46cd-a0a6-0fc142e1a293" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] snapshot: d8c4e7f6-ca9b-4397-9e22-1794c6616f29, volume: 22ec4451-a5b0-46cd-a0a6-0fc142e1a293,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c754937a-1917-42d9-ab73-26efc177f9dc]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:08 devstack sudo[95615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29
Jul 07 22:40:08 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:09 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29" returned: 0 in 1.211s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a22b077d-ca40-4c83-8bdd-5a323720b85d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:40:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:40:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:40:09 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2e1a3a-3ddd-4155-937f-dffbf00b1537]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:09 devstack sudo[95640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d
Jul 07 22:40:09 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:10 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d" returned: 0 in 1.152s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:10 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293 not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:40:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:10 devstack sudo[95652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293
Jul 07 22:40:10 devstack sudo[95652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:15 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=43,cinder:INSERT=6,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:40:15 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=29,cinder:DELETE=2,cinder:SELECT=35,cinder:INSERT=7 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Flow 'volume_create_manager' (4c83fc6e-f342-440a-8c25-624023375527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01d4468-5c36-45af-aff3-6568a02a1ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01d4468-5c36-45af-aff3-6568a02a1ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-643132014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28cc46f64c1c4b38ae88096e501fdddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:17Z,use_quota=True,user_id='d96396dd431d439ab0abc3afbb9457a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb8e282-21b5-487a-9169-4ce5986194fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb8e282-21b5-487a-9169-4ce5986194fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ab4c2d-0fe0-4b4d-83a6-bf3527b5a990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ab4c2d-0fe0-4b4d-83a6-bf3527b5a990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3', 'volume_name': 'volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69461e33-7d0e-4883-a1c8-97ba9eff7462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69461e33-7d0e-4883-a1c8-97ba9eff7462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db265ef-38d9-4b33-b881-91c06917626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:17 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Volume 11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3', 'volume_size': 1}
Jul 07 22:40:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:20 devstack sudo[95652]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293" returned: 0 in 9.849s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:20 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc4fa8c-8a2a-442b-9830-da56380c9152]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:20 devstack sudo[95717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d
Jul 07 22:40:20 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:21 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d" returned: 0 in 1.213s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:21 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d, size 1024.00 MB, duration 9.85 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:40:21 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Converted 1024.00 MB image at 103.93 MB/s
Jul 07 22:40:21 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:40:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:21 devstack sudo[95723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293
Jul 07 22:40:21 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:22 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293" returned: 0 in 0.679s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Lock "cinder-quobyte-22ec4451-a5b0-46cd-a0a6-0fc142e1a293" released by "_copy_volume_from_snapshot" :: held 14.271s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Acquiring lock "cinder-quobyte-d8c4e7f6-ca9b-4397-9e22-1794c6616f29" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Lock "cinder-quobyte-d8c4e7f6-ca9b-4397-9e22-1794c6616f29" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Deleting offline snapshot d8c4e7f6-ca9b-4397-9e22-1794c6616f29 of volume a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] snapshot_file for this snap is: volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[928a8589-8644-4ce0-8c2d-85beb82584f6]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:22 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29
Jul 07 22:40:22 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:22 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29" returned: 0 in 0.829s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a22b077d-ca40-4c83-8bdd-5a323720b85d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[925fd6ee-21c4-4da2-a7f5-fcdfb1779884]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:23 devstack sudo[95731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d
Jul 07 22:40:23 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:23 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d" returned: 0 in 0.837s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:23 devstack sudo[95737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29
Jul 07 22:40:23 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:24 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29" returned: 0 in 0.804s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:24 devstack sudo[95742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29
Jul 07 22:40:24 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:25 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d.d8c4e7f6-ca9b-4397-9e22-1794c6616f29" returned: 0 in 0.687s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Lock "cinder-quobyte-d8c4e7f6-ca9b-4397-9e22-1794c6616f29" released by "_delete_snapshot" :: held 3.277s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.433s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.606s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-643132014',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28cc46f64c1c4b38ae88096e501fdddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:17Z,use_quota=True,user_id='d96396dd431d439ab0abc3afbb9457a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Creating volume 11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:40:25 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:40:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:25 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3 1073741824
Jul 07 22:40:25 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:25 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-299aa8db-d1c8-48b2-8d16-c31d177c0aed tempest-GroupsV314Test-511471201 None] Create group from source-group-8703753a-4267-400d-b036-ac7f93223262 completed successfully.
Jul 07 22:40:26 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3 1073741824" returned: 0 in 1.060s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:26 devstack sudo[95750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3
Jul 07 22:40:26 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Acquiring lock "cinder-quobyte-22ec4451-a5b0-46cd-a0a6-0fc142e1a293" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Lock "cinder-quobyte-22ec4451-a5b0-46cd-a0a6-0fc142e1a293" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:26 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8cb7f3-2c26-433e-bee1-fd678aabfeff]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:26 devstack sudo[95752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293
Jul 07 22:40:26 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:27 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3" returned: 0 in 0.801s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:40:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2db265ef-38d9-4b33-b881-91c06917626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c752581-adab-4c11-95b2-9211306fd54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:27 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Volume volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3 (11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3): created successfully
Jul 07 22:40:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c752581-adab-4c11-95b2-9211306fd54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Flow 'volume_create_manager' (4c83fc6e-f342-440a-8c25-624023375527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9e276364-0b7c-47be-a0f7-320c47e4cef4 tempest-AttachVolumeTestJSON-835086648 None] Created volume successfully.
Jul 07 22:40:27 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293" returned: 0 in 0.935s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:27 devstack sudo[95758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293
Jul 07 22:40:27 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:28 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-22ec4451-a5b0-46cd-a0a6-0fc142e1a293" returned: 0 in 0.848s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Lock "cinder-quobyte-22ec4451-a5b0-46cd-a0a6-0fc142e1a293" released by "delete_volume" :: held 1.861s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:28 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Created reservations ['0df70e21-cd48-4277-98ec-7a6f9f50a93e'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:28 devstack cinder-volume[88077]: WARNING cinder.quota [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1216068321 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1216068321, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:40:28 devstack cinder-volume[88077]: WARNING cinder.quota [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1216068321 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1216068321, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:40:28 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Created reservations ['03116cda-55d5-40d0-8224-c4b49755d2d6', '0d07dd56-69f4-44de-9320-1b285e456e63', '17d029cc-a217-44bf-a62b-14a7de11c8e2', '745ac687-4bbe-4946-b800-9067356f84d0'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:28 devstack sudo[95765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:40:28 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Acquiring lock "cinder-quobyte-a22b077d-ca40-4c83-8bdd-5a323720b85d" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Lock "cinder-quobyte-a22b077d-ca40-4c83-8bdd-5a323720b85d" acquired by "delete_volume" :: waited 0.037s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:29 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c15b04a-741e-4cfa-a480-4df7232b85d8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:29 devstack sudo[95767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d
Jul 07 22:40:29 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:29 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.861s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:29 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:29 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a5ba3ced-1549-4174-9d8b-49218b179509 tempest-GroupsV314Test-511471201 None] Delete group completed successfully.
Jul 07 22:40:30 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d" returned: 0 in 0.879s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:30 devstack sudo[95774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d
Jul 07 22:40:30 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:31 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a22b077d-ca40-4c83-8bdd-5a323720b85d" returned: 0 in 0.830s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Lock "cinder-quobyte-a22b077d-ca40-4c83-8bdd-5a323720b85d" released by "delete_volume" :: held 1.786s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Created reservations ['f497e079-cf5a-42a7-9576-df6d817022fd'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Created reservations ['c9df94a8-ab3a-4838-b8a2-0d6504da6cea', '016eb89e-ab57-46bf-b313-ff5368631dd2', 'c20a5036-9f71-47da-bb12-5d84c2313035', 'b4c8f59d-ec57-4f7c-80e4-728bc7abfc19'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:31 devstack sudo[95778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:40:31 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-ea5e960c-f4e1-4928-91c8-400b96dd8394 req-7f9e9066-bb56-4aaf-8a2d-625a95950f87 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-ea5e960c-f4e1-4928-91c8-400b96dd8394 req-7f9e9066-bb56-4aaf-8a2d-625a95950f87 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f6e5cf-a475-4b09-9905-315a1da4432f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-ea5e960c-f4e1-4928-91c8-400b96dd8394 req-7f9e9066-bb56-4aaf-8a2d-625a95950f87 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:31 devstack sudo[95788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3
Jul 07 22:40:31 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:32 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.795s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:32 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-7da3f43a-2303-4d3d-9ec1-dd0229412f5f tempest-GroupsV314Test-511471201 None] Delete group completed successfully.
Jul 07 22:40:32 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-ea5e960c-f4e1-4928-91c8-400b96dd8394 req-7f9e9066-bb56-4aaf-8a2d-625a95950f87 tempest-AttachVolumeTestJSON-835086648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3" returned: 0 in 0.913s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-ea5e960c-f4e1-4928-91c8-400b96dd8394 req-7f9e9066-bb56-4aaf-8a2d-625a95950f87 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.939s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-ea5e960c-f4e1-4928-91c8-400b96dd8394 req-7f9e9066-bb56-4aaf-8a2d-625a95950f87 tempest-AttachVolumeTestJSON-835086648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f1423c2d-101b-4dab-a7b8-7169c7289fb0', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:40:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-ea5e960c-f4e1-4928-91c8-400b96dd8394 req-7f9e9066-bb56-4aaf-8a2d-625a95950f87 tempest-AttachVolumeTestJSON-835086648 None] attachment_update completed successfully.
Jul 07 22:40:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9b3e157b-1281-4a18-b983-ed1536ebc9e0 tempest-GroupsV320Test-376319613 None] Group tempest-GroupsV320Test-Group-72638212: creating
Jul 07 22:40:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9b3e157b-1281-4a18-b983-ed1536ebc9e0 tempest-GroupsV320Test-376319613 None] Group tempest-GroupsV320Test-Group-72638212: created successfully
Jul 07 22:40:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9b3e157b-1281-4a18-b983-ed1536ebc9e0 tempest-GroupsV320Test-376319613 None] Create group completed successfully.
Jul 07 22:40:39 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-85252e79-9201-491e-aad1-d196dd8a0338 tempest-GroupsV320Test-376319613 None] Created reservations ['613b9682-d190-400d-a550-dc625808f0c5'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-85252e79-9201-491e-aad1-d196dd8a0338 tempest-GroupsV320Test-376319613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-85252e79-9201-491e-aad1-d196dd8a0338 tempest-GroupsV320Test-376319613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-85252e79-9201-491e-aad1-d196dd8a0338 tempest-GroupsV320Test-376319613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-85252e79-9201-491e-aad1-d196dd8a0338 tempest-GroupsV320Test-376319613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-85252e79-9201-491e-aad1-d196dd8a0338 tempest-GroupsV320Test-376319613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-85252e79-9201-491e-aad1-d196dd8a0338 tempest-GroupsV320Test-376319613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:39 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:40:39 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:40 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-85252e79-9201-491e-aad1-d196dd8a0338 tempest-GroupsV320Test-376319613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.823s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:40 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-85252e79-9201-491e-aad1-d196dd8a0338 tempest-GroupsV320Test-376319613 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:40 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-85252e79-9201-491e-aad1-d196dd8a0338 tempest-GroupsV320Test-376319613 None] Delete group completed successfully.
Jul 07 22:40:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:40:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:43 devstack sudo[95819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:40:43 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:44 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.878s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:40:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 28 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:40:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:40:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-6d984612-b3ab-4db2-904e-c2c326b7e910 req-75071581-e7d0-4171-b400-d765b8281b85 tempest-TestMinimumBasicScenario-1051033023 None] Terminate volume connection completed successfully.
Jul 07 22:40:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-6d984612-b3ab-4db2-904e-c2c326b7e910 req-75071581-e7d0-4171-b400-d765b8281b85 tempest-TestMinimumBasicScenario-1051033023 None] Deleting attachment 8dd7a153-a8d0-4b21-897d-4c845a4cbfbd. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:40:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Acquiring lock "cinder-a08d662d-2e89-484f-a746-c8bfa856c94c-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Lock "cinder-a08d662d-2e89-484f-a746-c8bfa856c94c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Acquiring lock "cinder-quobyte-a08d662d-2e89-484f-a746-c8bfa856c94c" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Lock "cinder-quobyte-a08d662d-2e89-484f-a746-c8bfa856c94c" acquired by "delete_volume" :: waited 0.036s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:50 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f0656b-f543-4030-a35c-57ba4be50214]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:50 devstack sudo[95933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c
Jul 07 22:40:50 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:52 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c" returned: 0 in 1.580s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:52 devstack sudo[95962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c
Jul 07 22:40:52 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:53 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a08d662d-2e89-484f-a746-c8bfa856c94c" returned: 0 in 1.421s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Lock "cinder-quobyte-a08d662d-2e89-484f-a746-c8bfa856c94c" released by "delete_volume" :: held 3.085s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:53 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Created reservations ['a322d8be-68a6-44ad-8bc7-5c3f3b95fcc2', 'fd856a2c-4b43-4116-bb9e-c8aec1893fe2', '7e2e3687-e2d0-407a-958d-778c2ad1d2f2', '60a3a59c-25fa-40dd-b906-fbbaaf409b95'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:54 devstack sudo[95966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:40:54 devstack sudo[95966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:55 devstack sudo[95966]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.116s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:55 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Deleted volume successfully.
Jul 07 22:40:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-912c26f2-a755-4f5d-9346-afa9b9dffba3 tempest-TestMinimumBasicScenario-1051033023 None] Lock "cinder-a08d662d-2e89-484f-a746-c8bfa856c94c-delete_volume" released by "delete_volume" :: held 4.717s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-84180379-829d-4cd0-ad1b-447bc77f827a req-4686d726-65cb-4c2a-b170-c321b7106861 tempest-TestShelveInstance-550520810 None] Terminate volume connection completed successfully.
Jul 07 22:40:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-84180379-829d-4cd0-ad1b-447bc77f827a req-4686d726-65cb-4c2a-b170-c321b7106861 tempest-TestShelveInstance-550520810 None] Deleting attachment 410d05ae-ceb1-45dd-b2f4-198934854089. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:40:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Acquiring lock "cinder-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Lock "cinder-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Acquiring lock "cinder-quobyte-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Lock "cinder-quobyte-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" acquired by "delete_volume" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:56 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ba139a-24d1-4012-a988-252ac121f133]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:56 devstack sudo[95977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:40:56 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:57 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 0 in 1.578s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:57 devstack sudo[95997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:40:57 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:58 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 1 in 1.158s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:40:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:58 devstack sudo[96004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9
Jul 07 22:40:58 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:00 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" returned: 0 in 1.251s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Lock "cinder-quobyte-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9" released by "delete_volume" :: held 4.080s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:00 devstack cinder-volume[88077]: DEBUG cinder.quota [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Created reservations ['964723cb-a2f3-412e-8fea-561b58149535', '40ac0202-dd1a-4887-890c-51a5bc9757ee', 'dd498961-bc45-4418-b1ab-5c79d98557d0', 'ebecc932-6ee8-4f75-9880-1c3698e500b5'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:00 devstack sudo[96008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:41:00 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:01 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.085s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:01 devstack cinder-volume[88077]: DEBUG cinder.manager [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Deleted volume successfully.
Jul 07 22:41:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [req-84180379-829d-4cd0-ad1b-447bc77f827a req-a63d598e-a7f0-41a6-a3ae-a50ad625a4d1 tempest-TestShelveInstance-550520810 None] Lock "cinder-9d6679bc-5dbc-46b3-8f1f-c8321f5ea7b9-delete_volume" released by "delete_volume" :: held 5.536s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Flow 'volume_create_manager' (72d8bc39-324f-43c3-a34d-70aac16694a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6cd6ae-18fc-4fee-bd8f-c2b7bc9ac72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6cd6ae-18fc-4fee-bd8f-c2b7bc9ac72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-587818521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfbbe0e-d8cf-4829-90e7-bdb138367275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d838325997b14d28b4f8ddf466344bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:09Z,use_quota=True,user_id='e07989f958cd4a378ec78c487b427785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2be7a3-a3c7-4a53-a213-3e5cd23eb2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2be7a3-a3c7-4a53-a213-3e5cd23eb2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e637ba-73e6-413a-966e-cced72ebe22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e637ba-73e6-413a-966e-cced72ebe22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cfbbe0e-d8cf-4829-90e7-bdb138367275', 'volume_name': 'volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19241b4-9397-4750-be40-9436fbbf91ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19241b4-9397-4750-be40-9436fbbf91ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa56a09-9f26-458a-ad5f-ee595db8a509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Volume 5cfbbe0e-d8cf-4829-90e7-bdb138367275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275', 'volume_size': 1}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-587818521',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cfbbe0e-d8cf-4829-90e7-bdb138367275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d838325997b14d28b4f8ddf466344bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:09Z,use_quota=True,user_id='e07989f958cd4a378ec78c487b427785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Creating volume 5cfbbe0e-d8cf-4829-90e7-bdb138367275 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:08 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:41:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:08 devstack sudo[96030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275 1073741824
Jul 07 22:41:08 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:09 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275 1073741824" returned: 0 in 1.109s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:10 devstack sudo[96035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275
Jul 07 22:41:10 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:10 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275" returned: 0 in 0.833s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa56a09-9f26-458a-ad5f-ee595db8a509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1042d13-82e8-4524-bb16-78a30859bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:10 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Volume volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275 (5cfbbe0e-d8cf-4829-90e7-bdb138367275): created successfully
Jul 07 22:41:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1042d13-82e8-4524-bb16-78a30859bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Flow 'volume_create_manager' (72d8bc39-324f-43c3-a34d-70aac16694a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:10 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d67eef3f-92e6-4981-bc43-e15095c75ab9 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Created volume successfully.
Jul 07 22:41:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Acquiring lock "cinder-5cfbbe0e-d8cf-4829-90e7-bdb138367275-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "cinder-5cfbbe0e-d8cf-4829-90e7-bdb138367275-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Acquiring lock "cinder-quobyte-5cfbbe0e-d8cf-4829-90e7-bdb138367275" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "cinder-quobyte-5cfbbe0e-d8cf-4829-90e7-bdb138367275" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:12 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aef3d1-36f6-4258-85ed-9a67302dca77]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:12 devstack sudo[96041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275
Jul 07 22:41:12 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:13 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275" returned: 0 in 1.049s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:13 devstack sudo[96047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275
Jul 07 22:41:13 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:14 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5cfbbe0e-d8cf-4829-90e7-bdb138367275" returned: 0 in 1.055s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "cinder-quobyte-5cfbbe0e-d8cf-4829-90e7-bdb138367275" released by "delete_volume" :: held 2.171s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:14 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Created reservations ['1758830e-a237-44e9-ba87-2348172b2607', 'bd180bf2-4262-4d40-963a-864f6eb95ce6', '22ae0462-6236-4456-8c59-7c5a44534c83', 'abee8e2c-3104-4425-9d68-a86035999807'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:14 devstack sudo[96085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:41:14 devstack sudo[96085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:15 devstack sudo[96085]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.840s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:15 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:15 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Deleted volume successfully.
Jul 07 22:41:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3561c858-4446-405e-a103-3fd5d8bb9b24 tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "cinder-5cfbbe0e-d8cf-4829-90e7-bdb138367275-delete_volume" released by "delete_volume" :: held 3.335s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=55,cinder:UPDATE=60,cinder:INSERT=13,cinder:DELETE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=61,cinder:SELECT=49,cinder:DELETE=2,cinder:INSERT=12 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Flow 'volume_create_manager' (7a184b4c-3c55-4e4f-8a2a-1fbbb4c47968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841b45ee-dd29-4b17-8662-eee7e43297ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841b45ee-dd29-4b17-8662-eee7e43297ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1402613768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f90600-e334-4ac3-8e38-6d13218df51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d838325997b14d28b4f8ddf466344bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:16Z,use_quota=True,user_id='e07989f958cd4a378ec78c487b427785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddce0909-0fac-416b-bb71-4624134709e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddce0909-0fac-416b-bb71-4624134709e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf7b70f-ff66-45db-9c86-9c9f350cb2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bf7b70f-ff66-45db-9c86-9c9f350cb2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f90600-e334-4ac3-8e38-6d13218df51a', 'volume_name': 'volume-b8f90600-e334-4ac3-8e38-6d13218df51a', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe98c90-93a2-4784-9b89-97a612ff5ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe98c90-93a2-4784-9b89-97a612ff5ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218cc1d4-f91b-453d-acce-d4d02742c608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Volume b8f90600-e334-4ac3-8e38-6d13218df51a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f90600-e334-4ac3-8e38-6d13218df51a', 'volume_size': 1}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1402613768',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f90600-e334-4ac3-8e38-6d13218df51a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d838325997b14d28b4f8ddf466344bcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:16Z,use_quota=True,user_id='e07989f958cd4a378ec78c487b427785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Creating volume b8f90600-e334-4ac3-8e38-6d13218df51a {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:16 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:16 devstack sudo[96095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a 1073741824
Jul 07 22:41:16 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Flow 'volume_create_manager' (8dbd50db-86c7-4a7d-abb2-ac9dc7d9bcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd256e0d-87fa-4579-aa6e-8d83134466bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd256e0d-87fa-4579-aa6e-8d83134466bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-816772764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548b9f2b-1af8-48e7-8624-e7a96c8fd8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb6275d5c34f7788a4036473c87430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:16Z,use_quota=True,user_id='0a7196ea3fa0468ab7fd1f635bd24468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704bd84a-256b-4b54-9ed1-22254b609e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704bd84a-256b-4b54-9ed1-22254b609e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d100efa-2014-4562-8b4e-b8c3c570ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d100efa-2014-4562-8b4e-b8c3c570ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '548b9f2b-1af8-48e7-8624-e7a96c8fd8bf', 'volume_name': 'volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8c38df-3a16-42af-a4db-59e958df0a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8c38df-3a16-42af-a4db-59e958df0a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfc5224-f1c9-4050-83a8-1b0cec901d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Volume 548b9f2b-1af8-48e7-8624-e7a96c8fd8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf', 'volume_size': 1}
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-562e4883-3a7a-4162-9fbb-7464e27a4d54 req-91fa5ba4-7c44-4162-b992-e094a69bc8ae tempest-AttachVolumeTestJSON-835086648 None] Terminate volume connection completed successfully.
Jul 07 22:41:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-562e4883-3a7a-4162-9fbb-7464e27a4d54 req-91fa5ba4-7c44-4162-b992-e094a69bc8ae tempest-AttachVolumeTestJSON-835086648 None] Deleting attachment f1423c2d-101b-4dab-a7b8-7169c7289fb0. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:41:17 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a 1073741824" returned: 0 in 1.103s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:17 devstack sudo[96104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a
Jul 07 22:41:17 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:18 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a" returned: 0 in 0.757s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-816772764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=548b9f2b-1af8-48e7-8624-e7a96c8fd8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb6275d5c34f7788a4036473c87430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:16Z,use_quota=True,user_id='0a7196ea3fa0468ab7fd1f635bd24468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Creating volume 548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:18 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:18 devstack sudo[96108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf 1073741824
Jul 07 22:41:18 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218cc1d4-f91b-453d-acce-d4d02742c608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f90600-e334-4ac3-8e38-6d13218df51a', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db30f774-22a4-4778-b5b3-c660c4fb909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:18 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Volume volume-b8f90600-e334-4ac3-8e38-6d13218df51a (b8f90600-e334-4ac3-8e38-6d13218df51a): created successfully
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db30f774-22a4-4778-b5b3-c660c4fb909f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Flow 'volume_create_manager' (7a184b4c-3c55-4e4f-8a2a-1fbbb4c47968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:18 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d918c492-db07-455e-a968-b4d73c3486ca tempest-VolumeQuotasAdminTestJSON-1160578566 None] Created volume successfully.
Jul 07 22:41:19 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf 1073741824" returned: 0 in 1.261s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:19 devstack sudo[96119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf
Jul 07 22:41:19 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:20 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" returned: 0 in 0.769s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfc5224-f1c9-4050-83a8-1b0cec901d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43eca84-8d39-4763-b77d-dfd7564e93e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:20 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Volume volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf (548b9f2b-1af8-48e7-8624-e7a96c8fd8bf): created successfully
Jul 07 22:41:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43eca84-8d39-4763-b77d-dfd7564e93e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Flow 'volume_create_manager' (8dbd50db-86c7-4a7d-abb2-ac9dc7d9bcc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:20 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0de74fd5-f2bb-44c8-96b4-70aebcf2d6ec tempest-VolumeQuotasAdminTestJSON-321810977 None] Transfer volume completed successfully.
Jul 07 22:41:20 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8d9e1d53-c1c4-4a8a-8a9a-e9a4a2b8ab8f tempest-VolumeDependencyTests-1640820538 None] Created volume successfully.
Jul 07 22:41:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Creating offline snapshot f4cbc43e-04bc-485c-a246-bcc11726ef3f of volume 548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:41:21 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8b3d58-b29a-45a6-91a3-fffa276394bf]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:21 devstack sudo[96124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf
Jul 07 22:41:21 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Acquiring lock "cinder-b8f90600-e334-4ac3-8e38-6d13218df51a-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Lock "cinder-b8f90600-e334-4ac3-8e38-6d13218df51a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Acquiring lock "cinder-quobyte-b8f90600-e334-4ac3-8e38-6d13218df51a" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:22 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" returned: 0 in 0.937s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Lock "cinder-quobyte-b8f90600-e334-4ac3-8e38-6d13218df51a" acquired by "delete_volume" :: waited 0.042s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:22 devstack sudo[96129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f 1G
Jul 07 22:41:22 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[99365af5-23e2-4d85-abe0-9d4f7db4a80c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:22 devstack sudo[96131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a
Jul 07 22:41:22 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:23 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a" returned: 0 in 0.887s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:23 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f 1G" returned: 0 in 0.971s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:23 devstack sudo[96140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a
Jul 07 22:41:23 devstack sudo[96140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:23 devstack sudo[96141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f
Jul 07 22:41:23 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:23 devstack sudo[96140]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b8f90600-e334-4ac3-8e38-6d13218df51a" returned: 0 in 0.733s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Lock "cinder-quobyte-b8f90600-e334-4ac3-8e38-6d13218df51a" released by "delete_volume" :: held 1.669s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:23 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f" returned: 0 in 0.759s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:23 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f is being set with open permissions: ugo+rw
Jul 07 22:41:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:24 devstack sudo[96149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f
Jul 07 22:41:24 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:24 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f" returned: 0 in 0.697s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:24 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Created reservations ['beb1d0d2-62b9-4dd2-b296-b4a5a01ad1bc', '0c20e527-98a7-4ffe-a91c-dde4811b0661', '5f303a8f-10a4-4c41-a8cc-789fdb3e9d69', 'acc17dd0-df60-453b-8c59-87f8295ce2c8'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:25 devstack sudo[96152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.info
Jul 07 22:41:25 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:25 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.info" returned: 0 in 0.734s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:25 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.info is being set with open permissions: ugo+rw
Jul 07 22:41:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:26 devstack sudo[96155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.info
Jul 07 22:41:26 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:26 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.info" returned: 0 in 0.667s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.416s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:26 devstack sudo[96159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:41:26 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-25a68fb1-4585-4918-8eb6-49c16ef6b952 tempest-VolumeDependencyTests-1640820538 None] Create snapshot completed successfully
Jul 07 22:41:27 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.628s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:27 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Deleted volume successfully.
Jul 07 22:41:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-03664804-f971-4b13-8dd9-1a06492e0a1b tempest-VolumeQuotasAdminTestJSON-197395781 None] Lock "cinder-b8f90600-e334-4ac3-8e38-6d13218df51a-delete_volume" released by "delete_volume" :: held 5.596s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Flow 'volume_create_manager' (651dc822-8184-437c-ac8f-8176f429e19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81d5987-97c8-4ae5-83fc-3cf1f84ce717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81d5987-97c8-4ae5-83fc-3cf1f84ce717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-265503936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=419538d5-4507-45c5-9261-441b734fecec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15fb6275d5c34f7788a4036473c87430',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f4cbc43e-04bc-485c-a246-bcc11726ef3f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:29Z,use_quota=True,user_id='0a7196ea3fa0468ab7fd1f635bd24468',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3c425b-d8f4-47c2-848f-b1e7533807ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a3c425b-d8f4-47c2-848f-b1e7533807ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92998268-f69b-48bc-b0fd-2771e56df1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92998268-f69b-48bc-b0fd-2771e56df1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '419538d5-4507-45c5-9261-441b734fecec', 'volume_name': 'volume-419538d5-4507-45c5-9261-441b734fecec', 'volume_size': 1, 'snapshot_id': 'f4cbc43e-04bc-485c-a246-bcc11726ef3f'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b8fc3f-6932-42b1-b2f7-e52f782aae23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b8fc3f-6932-42b1-b2f7-e52f782aae23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219f0775-1010-42b7-a9cb-491316d6a3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:29 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Volume 419538d5-4507-45c5-9261-441b734fecec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-419538d5-4507-45c5-9261-441b734fecec', 'volume_size': 1, 'snapshot_id': 'f4cbc43e-04bc-485c-a246-bcc11726ef3f'}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "cinder-quobyte-f4cbc43e-04bc-485c-a246-bcc11726ef3f-419538d5-4507-45c5-9261-441b734fecec" by "_create_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-f4cbc43e-04bc-485c-a246-bcc11726ef3f-419538d5-4507-45c5-9261-441b734fecec" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Creating volume 419538d5-4507-45c5-9261-441b734fecec from snapshot f4cbc43e-04bc-485c-a246-bcc11726ef3f {{(pid=88077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "cinder-quobyte-419538d5-4507-45c5-9261-441b734fecec" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-419538d5-4507-45c5-9261-441b734fecec" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] snapshot: f4cbc43e-04bc-485c-a246-bcc11726ef3f, volume: 419538d5-4507-45c5-9261-441b734fecec,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf23e80-c47b-40de-a8dd-fcbaea98c0ef]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:29 devstack sudo[96186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f
Jul 07 22:41:29 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:30 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f" returned: 0 in 1.022s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:41:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:41:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:41:30 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da46786-68a4-4ed3-9eb3-2f0518af083e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:30 devstack sudo[96198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf
Jul 07 22:41:30 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:31 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" returned: 0 in 1.535s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:31 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:41:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:32 devstack sudo[96264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec
Jul 07 22:41:32 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:39 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=18,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:41:39 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=18,cinder:SELECT=13,cinder:INSERT=4,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:41:40 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec" returned: 0 in 8.937s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:40 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[320dd4c1-ebb4-4659-8fac-fc99c9abe0f5]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:41 devstack sudo[96289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf
Jul 07 22:41:41 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:42 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" returned: 0 in 1.330s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:42 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf, size 1024.00 MB, duration 8.94 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:41:42 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Converted 1024.00 MB image at 114.56 MB/s
Jul 07 22:41:42 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec is being set with open permissions: ugo+rw
Jul 07 22:41:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:42 devstack sudo[96295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec
Jul 07 22:41:42 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:43 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec" returned: 0 in 0.916s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-419538d5-4507-45c5-9261-441b734fecec" released by "_copy_volume_from_snapshot" :: held 13.935s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-f4cbc43e-04bc-485c-a246-bcc11726ef3f-419538d5-4507-45c5-9261-441b734fecec" released by "_create_volume_from_snapshot" :: held 13.988s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219f0775-1010-42b7-a9cb-491316d6a3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-419538d5-4507-45c5-9261-441b734fecec', 'volume_size': 1, 'snapshot_id': 'f4cbc43e-04bc-485c-a246-bcc11726ef3f'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8655035-4868-4492-97a0-3707f1a1bf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:43 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Volume volume-419538d5-4507-45c5-9261-441b734fecec (419538d5-4507-45c5-9261-441b734fecec): created successfully
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8655035-4868-4492-97a0-3707f1a1bf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Flow 'volume_create_manager' (651dc822-8184-437c-ac8f-8176f429e19c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-eda04309-e07b-425c-8824-73fa32fe380d tempest-VolumeDependencyTests-1640820538 None] Created volume successfully.
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:43 devstack sudo[96304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:41:43 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "cinder-f4cbc43e-04bc-485c-a246-bcc11726ef3f-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-f4cbc43e-04bc-485c-a246-bcc11726ef3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "cinder-quobyte-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "cinder-quobyte-f4cbc43e-04bc-485c-a246-bcc11726ef3f" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-f4cbc43e-04bc-485c-a246-bcc11726ef3f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Deleting offline snapshot f4cbc43e-04bc-485c-a246-bcc11726ef3f of volume 548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] snapshot_file for this snap is: volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[456673b4-10e9-472a-829b-6943556b91fd]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:44 devstack sudo[96306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f
Jul 07 22:41:44 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:44 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.091s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 28 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:41:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:41:45 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f" returned: 0 in 1.080s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e910ae40-e427-4e7d-bb74-147a2930f523]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:45 devstack sudo[96319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf
Jul 07 22:41:45 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Flow 'volume_create_manager' (ad26dfba-773a-4bc4-ba31-a8a7a59d8ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb58261f-09b9-4861-8092-3b3b893d7656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb58261f-09b9-4861-8092-3b3b893d7656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1153711956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dda6c8d-131d-4e32-8964-2a62bdfeacbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcad7756f6f04f39be530b2891d6a697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:46Z,use_quota=True,user_id='ba583dd03b7846f7ab0d4b0f2670d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9f9f23-25b0-4e3b-8cec-5ad4ad9f3214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf9f9f23-25b0-4e3b-8cec-5ad4ad9f3214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be47d9d9-97a8-4841-acdf-b2a7612c934b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be47d9d9-97a8-4841-acdf-b2a7612c934b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dda6c8d-131d-4e32-8964-2a62bdfeacbb', 'volume_name': 'volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45921ff-15bc-4d4a-b16e-dba2e391af2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45921ff-15bc-4d4a-b16e-dba2e391af2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce2accb-010b-431a-9da3-8525e1ae8846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:45 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Volume 3dda6c8d-131d-4e32-8964-2a62bdfeacbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb', 'volume_size': 1}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1153711956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dda6c8d-131d-4e32-8964-2a62bdfeacbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcad7756f6f04f39be530b2891d6a697',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:46Z,use_quota=True,user_id='ba583dd03b7846f7ab0d4b0f2670d740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Creating volume 3dda6c8d-131d-4e32-8964-2a62bdfeacbb {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:46 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:46 devstack sudo[96321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb 1073741824
Jul 07 22:41:46 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:46 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" returned: 0 in 0.907s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:46 devstack sudo[96326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f
Jul 07 22:41:46 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:46 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb 1073741824" returned: 0 in 0.982s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:47 devstack sudo[96333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb
Jul 07 22:41:47 devstack sudo[96333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:47 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f" returned: 0 in 0.926s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:47 devstack sudo[96337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f
Jul 07 22:41:47 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:47 devstack sudo[96333]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb" returned: 0 in 0.794s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] <== create_volume: return (1845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce2accb-010b-431a-9da3-8525e1ae8846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e34f27-0721-4db7-93e5-35110fc1a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:47 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Volume volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb (3dda6c8d-131d-4e32-8964-2a62bdfeacbb): created successfully
Jul 07 22:41:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07e34f27-0721-4db7-93e5-35110fc1a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Flow 'volume_create_manager' (ad26dfba-773a-4bc4-ba31-a8a7a59d8ed6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e1500756-9604-4c87-82fa-152dbd066ea1 tempest-VolumesServicesTestJSON-447776132 None] Created volume successfully.
Jul 07 22:41:48 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf.f4cbc43e-04bc-485c-a246-bcc11726ef3f" returned: 0 in 0.777s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-f4cbc43e-04bc-485c-a246-bcc11726ef3f" released by "_delete_snapshot" :: held 3.836s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" released by "delete_snapshot" :: held 3.872s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Created reservations ['4e2bb005-8484-4128-be50-a489a443893e', 'a311734e-798a-436f-899b-611fb36331e4', 'a06b0fcd-e1c5-4990-998d-bdb72055be1f', 'f8b7ae41-6ffb-464d-952c-a6b901510aa6'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:48 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Delete snapshot completed successfully.
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8640275-0fc3-455f-988b-e2435bc4560f tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-f4cbc43e-04bc-485c-a246-bcc11726ef3f-delete_snapshot" released by "delete_snapshot" :: held 4.070s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "cinder-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "cinder-quobyte-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fa4216-cf8e-45f9-adbd-0a2234bd3959]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:48 devstack sudo[96341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf
Jul 07 22:41:48 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Acquiring lock "cinder-3dda6c8d-131d-4e32-8964-2a62bdfeacbb-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Lock "cinder-3dda6c8d-131d-4e32-8964-2a62bdfeacbb-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Acquiring lock "cinder-quobyte-3dda6c8d-131d-4e32-8964-2a62bdfeacbb" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Lock "cinder-quobyte-3dda6c8d-131d-4e32-8964-2a62bdfeacbb" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:49 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[918e9997-4684-4a92-b2f0-6f99719b0764]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:49 devstack sudo[96343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb
Jul 07 22:41:49 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:49 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" returned: 0 in 0.996s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:49 devstack sudo[96348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf
Jul 07 22:41:49 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:50 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb" returned: 0 in 0.974s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:50 devstack sudo[96355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb
Jul 07 22:41:50 devstack sudo[96355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:50 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" returned: 0 in 0.773s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf" released by "delete_volume" :: held 1.857s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Created reservations ['58d2a40f-5c66-4604-85ab-94a1b318cd29', '4681dee2-5187-4022-8457-104ac3f992cf', 'b67b9c78-b8e3-4d18-b861-0c77e36b18cc', '3f9674f5-4585-40a7-b0bf-8f362ce745d3'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:50 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:41:50 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "cinder-419538d5-4507-45c5-9261-441b734fecec-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-419538d5-4507-45c5-9261-441b734fecec-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "cinder-quobyte-419538d5-4507-45c5-9261-441b734fecec" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-419538d5-4507-45c5-9261-441b734fecec" acquired by "delete_volume" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0c1951-6d8e-4e83-9aae-c28bba594711]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:51 devstack sudo[96359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec
Jul 07 22:41:51 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:51 devstack sudo[96355]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3dda6c8d-131d-4e32-8964-2a62bdfeacbb" returned: 0 in 1.006s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Lock "cinder-quobyte-3dda6c8d-131d-4e32-8964-2a62bdfeacbb" released by "delete_volume" :: held 2.067s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Created reservations ['bd372184-b929-4972-bf4e-5acdf36653f8', '3a76daec-0fbf-472e-ab3d-d21e2c9c9351', '86b93895-19ab-4139-bbdf-0dfaf0372a07', 'e4f82411-d6f2-43f7-a3c3-30656eb0ae0d'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:51 devstack sudo[96362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:41:51 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:51 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.189s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:51 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:51 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Deleted volume successfully.
Jul 07 22:41:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4169411a-b649-43ad-b181-6a041d862704 tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-548b9f2b-1af8-48e7-8624-e7a96c8fd8bf-delete_volume" released by "delete_volume" :: held 3.464s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:52 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec" returned: 0 in 1.472s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:52 devstack sudo[96368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec
Jul 07 22:41:52 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:52 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.992s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:52 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:52 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Deleted volume successfully.
Jul 07 22:41:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-68347acd-e539-4ac1-9c41-172061e8c233 tempest-VolumesServicesTestJSON-447776132 None] Lock "cinder-3dda6c8d-131d-4e32-8964-2a62bdfeacbb-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:53 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-419538d5-4507-45c5-9261-441b734fecec" returned: 0 in 0.959s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-quobyte-419538d5-4507-45c5-9261-441b734fecec" released by "delete_volume" :: held 2.497s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:53 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Created reservations ['c181ce90-24a5-48f8-bab2-82ff7171a457', 'bc015f4c-8919-4467-99af-fcb9df4de97c', '860847ce-b59a-4aea-bdb5-56552ee68579', 'ca6fcaad-707a-482b-a671-748558a491b7'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:53 devstack sudo[96372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:41:53 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:54 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.892s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:54 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:54 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Deleted volume successfully.
Jul 07 22:41:54 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-22c500d2-5728-4147-b6b1-3b4383f3920e tempest-VolumeDependencyTests-1640820538 None] Lock "cinder-419538d5-4507-45c5-9261-441b734fecec-delete_volume" released by "delete_volume" :: held 3.659s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Flow 'volume_create_manager' (981eb36c-38f0-403c-8a67-80e0715b7500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a44c0d-3c61-4629-b7a1-654ccf44592f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a44c0d-3c61-4629-b7a1-654ccf44592f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1177482474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200ab4c3-7e65-4617-8115-fea32f23a7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721cd92b68864b98a1e2c5864a1e1f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:58Z,use_quota=True,user_id='c973203933f14f6290e8cc0d09fc2eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faf7ddb-7493-4c58-8290-c5ebde2ad2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faf7ddb-7493-4c58-8290-c5ebde2ad2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa248ae-8b8d-44d0-bf8c-6edcc9631e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fa248ae-8b8d-44d0-bf8c-6edcc9631e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '200ab4c3-7e65-4617-8115-fea32f23a7b7', 'volume_name': 'volume-200ab4c3-7e65-4617-8115-fea32f23a7b7', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564af557-b699-4d64-84f5-9f6d95c12a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (564af557-b699-4d64-84f5-9f6d95c12a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0beb895-6b89-4a3a-ab3d-a8b5cf53eba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:57 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Volume 200ab4c3-7e65-4617-8115-fea32f23a7b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-200ab4c3-7e65-4617-8115-fea32f23a7b7', 'volume_size': 1}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1177482474',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200ab4c3-7e65-4617-8115-fea32f23a7b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721cd92b68864b98a1e2c5864a1e1f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:58Z,use_quota=True,user_id='c973203933f14f6290e8cc0d09fc2eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Creating volume 200ab4c3-7e65-4617-8115-fea32f23a7b7 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:57 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:41:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:57 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7 1073741824
Jul 07 22:41:57 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Flow 'volume_create_manager' (a849d13e-2915-46db-a786-933e6295da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35c310c-a7c2-4e3f-82a8-3262d3fb95aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f35c310c-a7c2-4e3f-82a8-3262d3fb95aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-934221199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4a0026-af64-470d-85b9-2d53430a61d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721cd92b68864b98a1e2c5864a1e1f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:58Z,use_quota=True,user_id='c973203933f14f6290e8cc0d09fc2eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dabeef-6056-4876-b867-1c5c2e7f85a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dabeef-6056-4876-b867-1c5c2e7f85a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8e54eb-b67e-406c-b8ab-27c89d0790c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf8e54eb-b67e-406c-b8ab-27c89d0790c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d4a0026-af64-470d-85b9-2d53430a61d1', 'volume_name': 'volume-8d4a0026-af64-470d-85b9-2d53430a61d1', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c30dd1-c04d-4e4a-abb4-14c15da2e2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c30dd1-c04d-4e4a-abb4-14c15da2e2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26d88bc-463e-44f8-be63-3e56d887a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:58 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Volume 8d4a0026-af64-470d-85b9-2d53430a61d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d4a0026-af64-470d-85b9-2d53430a61d1', 'volume_size': 1}
Jul 07 22:41:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:59 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7 1073741824" returned: 0 in 1.425s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:59 devstack sudo[96405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7
Jul 07 22:41:59 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:00 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7" returned: 0 in 1.061s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] <== create_volume: return (2580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.583s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.031s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-934221199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d4a0026-af64-470d-85b9-2d53430a61d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='721cd92b68864b98a1e2c5864a1e1f46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:58Z,use_quota=True,user_id='c973203933f14f6290e8cc0d09fc2eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Creating volume 8d4a0026-af64-470d-85b9-2d53430a61d1 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:42:00 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0beb895-6b89-4a3a-ab3d-a8b5cf53eba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200ab4c3-7e65-4617-8115-fea32f23a7b7', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca772c4a-31e7-4133-b62c-02142ce7e3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:00 devstack sudo[96411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1 1073741824
Jul 07 22:42:00 devstack sudo[96411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:00 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Volume volume-200ab4c3-7e65-4617-8115-fea32f23a7b7 (200ab4c3-7e65-4617-8115-fea32f23a7b7): created successfully
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca772c4a-31e7-4133-b62c-02142ce7e3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Flow 'volume_create_manager' (981eb36c-38f0-403c-8a67-80e0715b7500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ee880a35-5fdc-4121-a2b4-224ff417bf79 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Created volume successfully.
Jul 07 22:42:01 devstack sudo[96411]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1 1073741824" returned: 0 in 1.284s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:01 devstack sudo[96419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1
Jul 07 22:42:01 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:02 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1" returned: 0 in 1.295s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] <== create_volume: return (2645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:42:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.651s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26d88bc-463e-44f8-be63-3e56d887a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d4a0026-af64-470d-85b9-2d53430a61d1', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7156a1c-6414-41bb-b829-4fe86378f6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:03 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Volume volume-8d4a0026-af64-470d-85b9-2d53430a61d1 (8d4a0026-af64-470d-85b9-2d53430a61d1): created successfully
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7156a1c-6414-41bb-b829-4fe86378f6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Flow 'volume_create_manager' (a849d13e-2915-46db-a786-933e6295da24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:03 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d9040df2-c2cc-41aa-8355-0e6b292d3d3f tempest-TestServerVolumeAttachmentScenario-1804836504 None] Created volume successfully.
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Flow 'volume_create_manager' (73f4dc62-f3c8-484c-a084-9dfe5fa5eb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312eab5c-26df-4476-8121-b673b97e1701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (312eab5c-26df-4476-8121-b673b97e1701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-641042724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5531daaf784703a703e96b35c229c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:03Z,use_quota=True,user_id='b6bff22ed18e42c1b86864151182f270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71460636-b8b2-4b7e-ad1d-e07c00a1e04c),volume_type_id=71460636-b8b2-4b7e-ad1d-e07c00a1e04c)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef3f634-7ffb-4ca7-b3b5-6cd4224108be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef3f634-7ffb-4ca7-b3b5-6cd4224108be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a548a76-6e74-4feb-a444-13aad7ba667a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a548a76-6e74-4feb-a444-13aad7ba667a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44', 'volume_name': 'volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397378ff-a0b2-4173-b778-57b7d6acd047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (397378ff-a0b2-4173-b778-57b7d6acd047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56216d6c-1c4b-4a52-a8e0-b1e6e100e62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:03 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Volume cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44', 'volume_size': 1}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-641042724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5531daaf784703a703e96b35c229c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:03Z,use_quota=True,user_id='b6bff22ed18e42c1b86864151182f270',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71460636-b8b2-4b7e-ad1d-e07c00a1e04c),volume_type_id=71460636-b8b2-4b7e-ad1d-e07c00a1e04c)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Creating volume cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:42:03 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:42:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:03 devstack sudo[96422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44 1073741824
Jul 07 22:42:03 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Flow 'volume_create_manager' (1e3315fa-d063-482b-8284-3dc9c267a7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26eb82b-fcf4-42b2-8454-b91b11003170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26eb82b-fcf4-42b2-8454-b91b11003170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c55fb51-69d0-4896-9793-f137dcfc3358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2498dca829b420cbf0ff68527cb6b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:04Z,use_quota=True,user_id='5dc8983e3ec442d9a99cf8fbec29255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:04 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2102f01c-89d4-4b0d-af6c-d880d0f88684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2102f01c-89d4-4b0d-af6c-d880d0f88684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9c2dac-ee07-41ac-b11b-029fdbc2fe43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.image.glance [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Creating Keystone auth plugin from conf {{(pid=88077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44 1073741824" returned: 0 in 1.193s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:04 devstack sudo[96432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44
Jul 07 22:42:04 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9c2dac-ee07-41ac-b11b-029fdbc2fe43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5c55fb51-69d0-4896-9793-f137dcfc3358', 'volume_name': 'volume-5c55fb51-69d0-4896-9793-f137dcfc3358', 'volume_size': 1, 'image_id': '9a4d92fb-7970-4a3b-8f94-e8054f844972', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a4d92fb-7970-4a3b-8f94-e8054f844972', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bf6abd8d1c822f701fa18566f20ef64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2498dca829b420cbf0ff68527cb6b22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab5f3eb0f1623702dcb662a3f82d0cce43cdc72877a36230482acbda455c9d50adf543bc9953d2fdd0ea13754bab2cb8d9aff89ecb7ab4f9ed65d4a9aeb50928', 'id': '9a4d92fb-7970-4a3b-8f94-e8054f844972', 'created_at': datetime.datetime(2026, 7, 7, 20, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 42, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a4d92fb-7970-4a3b-8f94-e8054f844972/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad729958e0>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d1094f-bd1d-4468-865f-7f8428dce3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d1094f-bd1d-4468-865f-7f8428dce3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b1f54d-49c6-4e51-a2d4-ec7e7d51b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:04 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Volume 5c55fb51-69d0-4896-9793-f137dcfc3358: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5c55fb51-69d0-4896-9793-f137dcfc3358', 'volume_size': 1, 'image_id': '9a4d92fb-7970-4a3b-8f94-e8054f844972', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a4d92fb-7970-4a3b-8f94-e8054f844972', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bf6abd8d1c822f701fa18566f20ef64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2498dca829b420cbf0ff68527cb6b22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab5f3eb0f1623702dcb662a3f82d0cce43cdc72877a36230482acbda455c9d50adf543bc9953d2fdd0ea13754bab2cb8d9aff89ecb7ab4f9ed65d4a9aeb50928', 'id': '9a4d92fb-7970-4a3b-8f94-e8054f844972', 'created_at': datetime.datetime(2026, 7, 7, 20, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 42, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a4d92fb-7970-4a3b-8f94-e8054f844972/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad729958e0>}
Jul 07 22:42:04 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Trying to clone 5c55fb51-69d0-4896-9793-f137dcfc3358 from image 9a4d92fb-7970-4a3b-8f94-e8054f844972 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a4d92fb-7970-4a3b-8f94-e8054f844972', 'metadata': {}}]). {{(pid=88077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:42:05 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:42:05 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 22:42:05 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c8d869-574e-49d0-8745-414e4e4bb225]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:05 devstack sudo[96436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD
Jul 07 22:42:05 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:05 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44" returned: 0 in 0.790s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:42:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56216d6c-1c4b-4a52-a8e0-b1e6e100e62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0e770f-9fe2-4855-96a0-dbb010f6502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:05 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Volume volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44 (cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44): created successfully
Jul 07 22:42:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0e770f-9fe2-4855-96a0-dbb010f6502e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Flow 'volume_create_manager' (73f4dc62-f3c8-484c-a084-9dfe5fa5eb5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:05 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c7fed92a-160b-4f35-93b8-86c702c821db tempest-VolumeTypesAccessTest-992773401 None] Created volume successfully.
Jul 07 22:42:06 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:06 devstack sudo[96441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD
Jul 07 22:42:06 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Acquiring lock "cinder-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Lock "cinder-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Acquiring lock "cinder-quobyte-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Lock "cinder-quobyte-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[55251541-c2a9-4262-8cd0-1052ad2592a4]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:06 devstack sudo[96443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44
Jul 07 22:42:06 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:06 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD" returned: 1 in 0.904s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:42:06 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Temporary image 9a4d92fb-7970-4a3b-8f94-e8054f844972 is fetched for user 5dc8983e3ec442d9a99cf8fbec29255d. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:42:07 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a9ad42-f406-4022-9ddd-6dad8fae0140]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:07 devstack sudo[96448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD
Jul 07 22:42:07 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:07 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44" returned: 0 in 0.935s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:07 devstack sudo[96453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44
Jul 07 22:42:07 devstack sudo[96453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:07 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD" returned: 0 in 0.875s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:08 devstack sudo[96457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD
Jul 07 22:42:08 devstack sudo[96457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:08 devstack sudo[96453]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44" returned: 0 in 0.916s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Lock "cinder-quobyte-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44" released by "delete_volume" :: held 1.922s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:08 devstack cinder-volume[88077]: WARNING cinder.quota [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1755906882 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1755906882, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:42:08 devstack cinder-volume[88077]: WARNING cinder.quota [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1755906882 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1755906882, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Created reservations ['6b233a8e-b476-49b2-b7fc-6cb6d3117511', '683da7e0-ba6c-488e-97a5-db0eccbb34be', '555726bd-8509-4cd1-a052-ed0895f408d7', 'edbc6c75-f570-464f-a485-58d50ff187e3'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:08 devstack sudo[96462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:42:08 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:08 devstack sudo[96457]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD" returned: 1 in 1.038s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c55fb51-69d0-4896-9793-f137dcfc3358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2498dca829b420cbf0ff68527cb6b22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:04Z,use_quota=True,user_id='5dc8983e3ec442d9a99cf8fbec29255d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Creating volume 5c55fb51-69d0-4896-9793-f137dcfc3358 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:42:08 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:42:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:09 devstack sudo[96465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 1073741824
Jul 07 22:42:09 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:09 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.984s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:09 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:09 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Deleted volume successfully.
Jul 07 22:42:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bbcbfb1c-fa85-4a77-9d32-65f8591934e4 tempest-VolumeTypesAccessTest-992773401 None] Lock "cinder-cf8d8cf1-8ba9-43d8-aafa-32d33a0c1a44-delete_volume" released by "delete_volume" :: held 3.273s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:10 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 1073741824" returned: 0 in 1.275s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:10 devstack sudo[96473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358
Jul 07 22:42:10 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:11 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358" returned: 0 in 1.069s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] <== create_volume: return (2410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:42:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.413s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:11 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Attempting download of 9a4d92fb-7970-4a3b-8f94-e8054f844972 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a4d92fb-7970-4a3b-8f94-e8054f844972', 'metadata': {}}])) to volume 5c55fb51-69d0-4896-9793-f137dcfc3358. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:42:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b6fd64-d0d1-4eb9-bd8a-80dfc61d53fa]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a4d92fb-7970-4a3b-8f94-e8054f844972_lscak7me {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:11 devstack sudo[96480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a4d92fb-7970-4a3b-8f94-e8054f844972_lscak7me
Jul 07 22:42:11 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:12 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a4d92fb-7970-4a3b-8f94-e8054f844972_lscak7me" returned: 0 in 1.143s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a4d92fb-7970-4a3b-8f94-e8054f844972_lscak7me {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:12 devstack sudo[96485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a4d92fb-7970-4a3b-8f94-e8054f844972_lscak7me
Jul 07 22:42:12 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:13 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a4d92fb-7970-4a3b-8f94-e8054f844972_lscak7me" returned: 1 in 1.013s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a4d92fb-7970-4a3b-8f94-e8054f844972_lscak7me' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:42:13 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[93faab09-746e-4ddc-8cbc-ba7bb3e18481]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:13 devstack sudo[96507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD
Jul 07 22:42:13 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:14 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD" returned: 0 in 0.943s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:14 devstack sudo[96512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD
Jul 07 22:42:14 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:15 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD" returned: 1 in 0.986s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:42:15 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] 9a4d92fb-7970-4a3b-8f94-e8054f844972 was raw, converting to raw {{(pid=88077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:42:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:15 devstack sudo[96553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358
Jul 07 22:42:15 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:16 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358" returned: 0 in 1.262s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:16 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a4d92fb-7970-4a3b-8f94-e8054f844972_f44ijsyydevstack@QuobyteHD, size 0.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:42:16 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 22:42:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:16 devstack sudo[96560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 1G
Jul 07 22:42:16 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:18 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 1G" returned: 0 in 1.259s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:18 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c83a329-ff0d-43d1-af9c-f156dbc55cf7]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:18 devstack sudo[96584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358
Jul 07 22:42:18 devstack sudo[96584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:19 devstack sudo[96584]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358" returned: 0 in 1.312s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:19 devstack sudo[96624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358
Jul 07 22:42:19 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=39,cinder:UPDATE=54,cinder:INSERT=7,cinder:DELETE=5 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:42:20 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358" returned: 1 in 1.246s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Downloaded image 9a4d92fb-7970-4a3b-8f94-e8054f844972 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a4d92fb-7970-4a3b-8f94-e8054f844972', 'metadata': {}}])) to volume 5c55fb51-69d0-4896-9793-f137dcfc3358 successfully. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Temporary image 9a4d92fb-7970-4a3b-8f94-e8054f844972 for user 5dc8983e3ec442d9a99cf8fbec29255d is deleted. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Marking volume 5c55fb51-69d0-4896-9793-f137dcfc3358 as bootable. {{(pid=88077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Copying metadata from image 9a4d92fb-7970-4a3b-8f94-e8054f844972 to 5c55fb51-69d0-4896-9793-f137dcfc3358. {{(pid=88077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Creating volume glance metadata for volume 5c55fb51-69d0-4896-9793-f137dcfc3358 backed by image 9a4d92fb-7970-4a3b-8f94-e8054f844972 with: {'image_id': '9a4d92fb-7970-4a3b-8f94-e8054f844972', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5bf6abd8d1c822f701fa18566f20ef64', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0b1f54d-49c6-4e51-a2d4-ec7e7d51b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c55fb51-69d0-4896-9793-f137dcfc3358', 'volume_size': 1, 'image_id': '9a4d92fb-7970-4a3b-8f94-e8054f844972', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a4d92fb-7970-4a3b-8f94-e8054f844972', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5bf6abd8d1c822f701fa18566f20ef64', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd2498dca829b420cbf0ff68527cb6b22', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ab5f3eb0f1623702dcb662a3f82d0cce43cdc72877a36230482acbda455c9d50adf543bc9953d2fdd0ea13754bab2cb8d9aff89ecb7ab4f9ed65d4a9aeb50928', 'id': '9a4d92fb-7970-4a3b-8f94-e8054f844972', 'created_at': datetime.datetime(2026, 7, 7, 20, 42, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 42, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a4d92fb-7970-4a3b-8f94-e8054f844972/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad729958e0>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b071d05-cdbb-4214-b1d3-74c0654e4b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:20 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Volume volume-5c55fb51-69d0-4896-9793-f137dcfc3358 (5c55fb51-69d0-4896-9793-f137dcfc3358): created successfully
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b071d05-cdbb-4214-b1d3-74c0654e4b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Flow 'volume_create_manager' (1e3315fa-d063-482b-8284-3dc9c267a7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:20 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-32ccf501-5903-48b9-89df-79b899d60af8 tempest-VolumeImageDependencyTests-381902665 None] Created volume successfully.
Jul 07 22:42:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Acquiring lock "cinder-5c55fb51-69d0-4896-9793-f137dcfc3358-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Lock "cinder-5c55fb51-69d0-4896-9793-f137dcfc3358-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Acquiring lock "cinder-quobyte-5c55fb51-69d0-4896-9793-f137dcfc3358" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Lock "cinder-quobyte-5c55fb51-69d0-4896-9793-f137dcfc3358" acquired by "delete_volume" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:21 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc9b2dd-874e-4410-8a38-bef7a6357136]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:21 devstack sudo[96660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358
Jul 07 22:42:21 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:22 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358" returned: 0 in 1.089s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:23 devstack sudo[96666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358
Jul 07 22:42:23 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:24 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358" returned: 1 in 1.993s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:42:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:24 devstack sudo[96718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358
Jul 07 22:42:24 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:26 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5c55fb51-69d0-4896-9793-f137dcfc3358" returned: 0 in 1.549s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Lock "cinder-quobyte-5c55fb51-69d0-4896-9793-f137dcfc3358" released by "delete_volume" :: held 4.782s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:26 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Created reservations ['8fe96e85-2ae1-4d4c-8781-4340652ca559', 'bc6005a3-22ae-4c00-96ab-35bbad0fdb2b', '28a8f5cf-e62a-4308-865c-79a3fee5faba', 'b34e89f4-569e-4051-a68f-aec25f1f51c3'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:42:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:26 devstack sudo[96737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:42:26 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:28 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.754s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:28 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:28 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Deleted volume successfully.
Jul 07 22:42:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f1ad1193-d326-4df1-81eb-fb93b7e77158 tempest-VolumeImageDependencyTests-381902665 None] Lock "cinder-5c55fb51-69d0-4896-9793-f137dcfc3358-delete_volume" released by "delete_volume" :: held 7.041s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:36 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=64,cinder:DELETE=5,cinder:SELECT=47,cinder:INSERT=25 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:42:38 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=7,cinder:INSERT=6,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:42:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:42:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:43 devstack sudo[96803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:42:43 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:44 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.840s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:42:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 28 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:42:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:42:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-0cabc657-1b67-4e83-a0e3-3574e7b62b11 req-56f05be1-ecd6-41b7-be4a-c6958dddd887 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-0cabc657-1b67-4e83-a0e3-3574e7b62b11 req-56f05be1-ecd6-41b7-be4a-c6958dddd887 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:51 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[30695853-69e4-45b3-b436-e0c8ebaefc40]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-0cabc657-1b67-4e83-a0e3-3574e7b62b11 req-56f05be1-ecd6-41b7-be4a-c6958dddd887 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:51 devstack sudo[96822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7
Jul 07 22:42:51 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:52 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-0cabc657-1b67-4e83-a0e3-3574e7b62b11 req-56f05be1-ecd6-41b7-be4a-c6958dddd887 tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7" returned: 0 in 1.039s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-0cabc657-1b67-4e83-a0e3-3574e7b62b11 req-56f05be1-ecd6-41b7-be4a-c6958dddd887 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.064s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-0cabc657-1b67-4e83-a0e3-3574e7b62b11 req-56f05be1-ecd6-41b7-be4a-c6958dddd887 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-200ab4c3-7e65-4617-8115-fea32f23a7b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b2eddfb-86b6-4063-8e83-a3168f236555', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:42:52 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-0cabc657-1b67-4e83-a0e3-3574e7b62b11 req-56f05be1-ecd6-41b7-be4a-c6958dddd887 tempest-TestServerVolumeAttachmentScenario-1804836504 None] attachment_update completed successfully.
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Flow 'volume_create_manager' (6cff49e4-2ece-442e-b71f-153749d5c8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e233f4c-c0b1-44aa-b8a5-7d0b5388eb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e233f4c-c0b1-44aa-b8a5-7d0b5388eb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-879470901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50072ec4-f083-40de-a9eb-a82058e3d9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28cc46f64c1c4b38ae88096e501fdddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:54Z,use_quota=True,user_id='d96396dd431d439ab0abc3afbb9457a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54915b1-4b75-4556-a992-412a3737fe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54915b1-4b75-4556-a992-412a3737fe99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff3740d-e4d1-46da-95aa-6ae06233d610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff3740d-e4d1-46da-95aa-6ae06233d610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50072ec4-f083-40de-a9eb-a82058e3d9e5', 'volume_name': 'volume-50072ec4-f083-40de-a9eb-a82058e3d9e5', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5336b3c-2dcc-4a39-83f4-fc55b679d460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5336b3c-2dcc-4a39-83f4-fc55b679d460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5b8d7c-c180-4a8f-8b51-51fc8bdcd979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:53 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Volume 50072ec4-f083-40de-a9eb-a82058e3d9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50072ec4-f083-40de-a9eb-a82058e3d9e5', 'volume_size': 1}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-879470901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50072ec4-f083-40de-a9eb-a82058e3d9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28cc46f64c1c4b38ae88096e501fdddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:54Z,use_quota=True,user_id='d96396dd431d439ab0abc3afbb9457a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Creating volume 50072ec4-f083-40de-a9eb-a82058e3d9e5 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:42:53 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:42:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:53 devstack sudo[97212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5 1073741824
Jul 07 22:42:53 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:54 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5 1073741824" returned: 0 in 1.072s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:54 devstack sudo[97218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5
Jul 07 22:42:54 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:55 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5" returned: 0 in 0.839s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:42:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5b8d7c-c180-4a8f-8b51-51fc8bdcd979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50072ec4-f083-40de-a9eb-a82058e3d9e5', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b7b5ca-fac6-4b9d-9fdc-6d7db60caea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:55 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Volume volume-50072ec4-f083-40de-a9eb-a82058e3d9e5 (50072ec4-f083-40de-a9eb-a82058e3d9e5): created successfully
Jul 07 22:42:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b7b5ca-fac6-4b9d-9fdc-6d7db60caea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Flow 'volume_create_manager' (6cff49e4-2ece-442e-b71f-153749d5c8bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d2426d6f-b436-488b-88b6-46f70e4d55b0 tempest-AttachVolumeTestJSON-835086648 None] Created volume successfully.
Jul 07 22:43:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-de974f0a-0c4f-4e8d-a515-ac55d5cc9005 req-a988bfc8-8f26-4a03-b75f-60d66e7ef133 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-de974f0a-0c4f-4e8d-a515-ac55d5cc9005 req-a988bfc8-8f26-4a03-b75f-60d66e7ef133 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:00 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[439f04f2-5d67-4066-ad2a-45ee3d7c2cc4]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-de974f0a-0c4f-4e8d-a515-ac55d5cc9005 req-a988bfc8-8f26-4a03-b75f-60d66e7ef133 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:00 devstack sudo[97242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5
Jul 07 22:43:00 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:00 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-de974f0a-0c4f-4e8d-a515-ac55d5cc9005 req-a988bfc8-8f26-4a03-b75f-60d66e7ef133 tempest-AttachVolumeTestJSON-835086648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5" returned: 0 in 0.837s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-de974f0a-0c4f-4e8d-a515-ac55d5cc9005 req-a988bfc8-8f26-4a03-b75f-60d66e7ef133 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.881s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-de974f0a-0c4f-4e8d-a515-ac55d5cc9005 req-a988bfc8-8f26-4a03-b75f-60d66e7ef133 tempest-AttachVolumeTestJSON-835086648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-50072ec4-f083-40de-a9eb-a82058e3d9e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf781ad6-c23e-449b-95de-94e1d300909d', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:43:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-de974f0a-0c4f-4e8d-a515-ac55d5cc9005 req-a988bfc8-8f26-4a03-b75f-60d66e7ef133 tempest-AttachVolumeTestJSON-835086648 None] attachment_update completed successfully.
Jul 07 22:43:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-93cdc7ab-cc60-46b9-9d37-424b7917c3c3 req-e8f43817-6010-47a7-8757-b227b4386e48 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-93cdc7ab-cc60-46b9-9d37-424b7917c3c3 req-e8f43817-6010-47a7-8757-b227b4386e48 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1ef1fa-cb43-483f-b9e2-e6ae38f032e3]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-93cdc7ab-cc60-46b9-9d37-424b7917c3c3 req-e8f43817-6010-47a7-8757-b227b4386e48 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:02 devstack sudo[97259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1
Jul 07 22:43:02 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:03 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-93cdc7ab-cc60-46b9-9d37-424b7917c3c3 req-e8f43817-6010-47a7-8757-b227b4386e48 tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1" returned: 0 in 0.926s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-93cdc7ab-cc60-46b9-9d37-424b7917c3c3 req-e8f43817-6010-47a7-8757-b227b4386e48 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-93cdc7ab-cc60-46b9-9d37-424b7917c3c3 req-e8f43817-6010-47a7-8757-b227b4386e48 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-8d4a0026-af64-470d-85b9-2d53430a61d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '757dc814-dc1f-45f7-a439-2cd0dad4b23e', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:43:03 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-93cdc7ab-cc60-46b9-9d37-424b7917c3c3 req-e8f43817-6010-47a7-8757-b227b4386e48 tempest-TestServerVolumeAttachmentScenario-1804836504 None] attachment_update completed successfully.
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Flow 'volume_create_manager' (315c6e3f-9d17-468b-a6a5-cdc8b599cfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde1d226-e93e-44bd-a8bd-ccf1334ddad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde1d226-e93e-44bd-a8bd-ccf1334ddad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-698842136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9595a2-4227-4287-ae12-0869c18914fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28cc46f64c1c4b38ae88096e501fdddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:06Z,use_quota=True,user_id='d96396dd431d439ab0abc3afbb9457a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a97637-800e-4820-bfaf-e352caa69615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a97637-800e-4820-bfaf-e352caa69615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1f232a-305c-4c86-b5bf-49cf5e645e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1f232a-305c-4c86-b5bf-49cf5e645e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9595a2-4227-4287-ae12-0869c18914fa', 'volume_name': 'volume-dc9595a2-4227-4287-ae12-0869c18914fa', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6737b79d-cb41-449e-b2fc-ee1d101696e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6737b79d-cb41-449e-b2fc-ee1d101696e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37aa3a19-c353-44aa-893f-3bc9dabe5eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:05 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Volume dc9595a2-4227-4287-ae12-0869c18914fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9595a2-4227-4287-ae12-0869c18914fa', 'volume_size': 1}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-698842136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc9595a2-4227-4287-ae12-0869c18914fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28cc46f64c1c4b38ae88096e501fdddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:06Z,use_quota=True,user_id='d96396dd431d439ab0abc3afbb9457a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Creating volume dc9595a2-4227-4287-ae12-0869c18914fa {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:05 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:43:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:05 devstack sudo[97285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa 1073741824
Jul 07 22:43:05 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:06 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa 1073741824" returned: 0 in 0.979s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:06 devstack sudo[97304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa
Jul 07 22:43:06 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:07 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa" returned: 0 in 1.036s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37aa3a19-c353-44aa-893f-3bc9dabe5eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9595a2-4227-4287-ae12-0869c18914fa', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f17b73-dce3-40ca-a5ad-548801ddfb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:07 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Volume volume-dc9595a2-4227-4287-ae12-0869c18914fa (dc9595a2-4227-4287-ae12-0869c18914fa): created successfully
Jul 07 22:43:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f17b73-dce3-40ca-a5ad-548801ddfb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Flow 'volume_create_manager' (315c6e3f-9d17-468b-a6a5-cdc8b599cfcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:08 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-59149d2a-7514-4d7e-b128-280c9de42157 tempest-AttachVolumeTestJSON-835086648 None] Created volume successfully.
Jul 07 22:43:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-d0772ae4-cba4-48ad-ac61-4290a3a4b732 req-49ec266b-6845-4674-87d6-84361025fed6 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-d0772ae4-cba4-48ad-ac61-4290a3a4b732 req-49ec266b-6845-4674-87d6-84361025fed6 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f693293-2052-4923-896c-28e9a978b9b0]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-d0772ae4-cba4-48ad-ac61-4290a3a4b732 req-49ec266b-6845-4674-87d6-84361025fed6 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:12 devstack sudo[97387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa
Jul 07 22:43:12 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:12 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-f42e667a-659b-4f8d-8d9b-ebeddc283074 req-d95403ee-572f-4d98-b3c7-fea180393448 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Terminate volume connection completed successfully.
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f42e667a-659b-4f8d-8d9b-ebeddc283074 req-d95403ee-572f-4d98-b3c7-fea180393448 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Deleting attachment 757dc814-dc1f-45f7-a439-2cd0dad4b23e. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (59e4bc4d-c875-468f-bece-34a9a5c534f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56be05b-0f56-410e-a82f-99fd496aba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f56be05b-0f56-410e-a82f-99fd496aba4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1734046160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fa1a62-53ff-4d02-a724-4df9386b1475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:13Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6aef10-bc7b-4963-ae3f-b7222c71d53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c6aef10-bc7b-4963-ae3f-b7222c71d53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04db9ad5-e8e8-4783-922a-fcf574d17d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04db9ad5-e8e8-4783-922a-fcf574d17d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85fa1a62-53ff-4d02-a724-4df9386b1475', 'volume_name': 'volume-85fa1a62-53ff-4d02-a724-4df9386b1475', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce37469-a55f-475b-8f81-7a888a3b2465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ce37469-a55f-475b-8f81-7a888a3b2465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3f936e-66c9-4bac-b159-5ec53570d61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:12 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Volume 85fa1a62-53ff-4d02-a724-4df9386b1475: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85fa1a62-53ff-4d02-a724-4df9386b1475', 'volume_size': 1}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:12 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-d0772ae4-cba4-48ad-ac61-4290a3a4b732 req-49ec266b-6845-4674-87d6-84361025fed6 tempest-AttachVolumeTestJSON-835086648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa" returned: 0 in 0.869s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-d0772ae4-cba4-48ad-ac61-4290a3a4b732 req-49ec266b-6845-4674-87d6-84361025fed6 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1734046160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fa1a62-53ff-4d02-a724-4df9386b1475,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:13Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Creating volume 85fa1a62-53ff-4d02-a724-4df9386b1475 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:12 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:12 devstack sudo[97418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475 1073741824
Jul 07 22:43:12 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-d0772ae4-cba4-48ad-ac61-4290a3a4b732 req-49ec266b-6845-4674-87d6-84361025fed6 tempest-AttachVolumeTestJSON-835086648 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-dc9595a2-4227-4287-ae12-0869c18914fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbfa36ed-7af1-433b-9f1c-fffe604244d4', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:43:12 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-d0772ae4-cba4-48ad-ac61-4290a3a4b732 req-49ec266b-6845-4674-87d6-84361025fed6 tempest-AttachVolumeTestJSON-835086648 None] attachment_update completed successfully.
Jul 07 22:43:13 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475 1073741824" returned: 0 in 1.014s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:13 devstack sudo[97425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475
Jul 07 22:43:13 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:14 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475" returned: 0 in 0.752s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3f936e-66c9-4bac-b159-5ec53570d61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85fa1a62-53ff-4d02-a724-4df9386b1475', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b7f9d3-b0b8-46ee-89ec-6c71668500a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:14 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Volume volume-85fa1a62-53ff-4d02-a724-4df9386b1475 (85fa1a62-53ff-4d02-a724-4df9386b1475): created successfully
Jul 07 22:43:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64b7f9d3-b0b8-46ee-89ec-6c71668500a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (59e4bc4d-c875-468f-bece-34a9a5c534f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:14 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-38815188-3883-4853-96a3-f34479f2c216 tempest-VolumesActionsTest-1156477007 None] Created volume successfully.
Jul 07 22:43:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-37b1ac85-881a-48fe-9b07-c6ad14dac6da tempest-VolumesActionsTest-1156477007 None] Acquiring lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475" by "attach_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-37b1ac85-881a-48fe-9b07-c6ad14dac6da tempest-VolumesActionsTest-1156477007 None] Lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475" acquired by "attach_volume" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:15 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-f5bcfb1f-8332-4777-9967-844635dbe1d6 req-360ecec9-2a37-4772-a2f6-c405f8831639 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Terminate volume connection completed successfully.
Jul 07 22:43:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f5bcfb1f-8332-4777-9967-844635dbe1d6 req-360ecec9-2a37-4772-a2f6-c405f8831639 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Deleting attachment 8b2eddfb-86b6-4063-8e83-a3168f236555. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:43:15 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-37b1ac85-881a-48fe-9b07-c6ad14dac6da tempest-VolumesActionsTest-1156477007 None] Attaching volume 85fa1a62-53ff-4d02-a724-4df9386b1475 to instance 29bc33e1-05a1-468c-a8a4-47c36a29976c at mountpoint /dev/vdb on host None.
Jul 07 22:43:15 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-37b1ac85-881a-48fe-9b07-c6ad14dac6da tempest-VolumesActionsTest-1156477007 None] Attach volume completed successfully.
Jul 07 22:43:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-37b1ac85-881a-48fe-9b07-c6ad14dac6da tempest-VolumesActionsTest-1156477007 None] Lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475" released by "attach_volume" :: held 0.126s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0d0b7350-ac49-4946-afdf-bae4b4759d68 tempest-VolumesActionsTest-423721168 None] Terminate volume connection completed successfully.
Jul 07 22:43:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0d0b7350-ac49-4946-afdf-bae4b4759d68 tempest-VolumesActionsTest-423721168 None] Acquiring lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475-detach_volume" by "detach_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0d0b7350-ac49-4946-afdf-bae4b4759d68 tempest-VolumesActionsTest-423721168 None] Lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0d0b7350-ac49-4946-afdf-bae4b4759d68 tempest-VolumesActionsTest-423721168 None] Detaching volume 85fa1a62-53ff-4d02-a724-4df9386b1475 from instance 29bc33e1-05a1-468c-a8a4-47c36a29976c.
Jul 07 22:43:17 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0d0b7350-ac49-4946-afdf-bae4b4759d68 tempest-VolumesActionsTest-423721168 None] Detach volume completed successfully.
Jul 07 22:43:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0d0b7350-ac49-4946-afdf-bae4b4759d68 tempest-VolumesActionsTest-423721168 None] Lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6d756d59-da4a-4db0-8466-b978f49783e6 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475-detach_volume" by "detach_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6d756d59-da4a-4db0-8466-b978f49783e6 tempest-VolumesActionsTest-1156477007 None] Lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:17 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6d756d59-da4a-4db0-8466-b978f49783e6 tempest-VolumesActionsTest-1156477007 None] Volume detach called, but volume not attached.
Jul 07 22:43:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6d756d59-da4a-4db0-8466-b978f49783e6 tempest-VolumesActionsTest-1156477007 None] Lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "cinder-quobyte-85fa1a62-53ff-4d02-a724-4df9386b1475" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Lock "cinder-quobyte-85fa1a62-53ff-4d02-a724-4df9386b1475" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:18 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[541a629a-4c86-4a91-a51e-1304bce557cd]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:18 devstack sudo[97473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475
Jul 07 22:43:18 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:19 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475" returned: 0 in 0.936s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:19 devstack sudo[97483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475
Jul 07 22:43:19 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:19 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-499e9fda-634c-4ad7-bee1-98bb42152d77 req-b114df5e-729a-42b6-b360-e39774a9f3a0 tempest-AttachVolumeTestJSON-835086648 None] Terminate volume connection completed successfully.
Jul 07 22:43:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-499e9fda-634c-4ad7-bee1-98bb42152d77 req-b114df5e-729a-42b6-b360-e39774a9f3a0 tempest-AttachVolumeTestJSON-835086648 None] Deleting attachment cf781ad6-c23e-449b-95de-94e1d300909d. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:43:20 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-85fa1a62-53ff-4d02-a724-4df9386b1475" returned: 0 in 1.128s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Lock "cinder-quobyte-85fa1a62-53ff-4d02-a724-4df9386b1475" released by "delete_volume" :: held 2.122s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:20 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Created reservations ['851c3c0c-4691-49e2-92b5-491517f0fab8', 'a6e53edf-34a2-43ad-9b84-6148f5d4439d', 'aa190886-118c-4777-9674-c54c981702fc', '60bd493d-0a44-4789-8d20-0822ad10bf32'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:20 devstack sudo[97506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:20 devstack sudo[97506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:21 devstack sudo[97506]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.967s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:21 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:21 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Deleted volume successfully.
Jul 07 22:43:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a7d9cabe-e8de-4740-94f6-2640b8f2bda8 tempest-VolumesActionsTest-1156477007 None] Lock "cinder-85fa1a62-53ff-4d02-a724-4df9386b1475-delete_volume" released by "delete_volume" :: held 3.436s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:22 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-d66aac4a-812c-4940-a13e-9df1e80f9221 req-9928dd7e-545c-408a-8481-7362f04988d3 tempest-AttachVolumeTestJSON-835086648 None] Terminate volume connection completed successfully.
Jul 07 22:43:22 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-d66aac4a-812c-4940-a13e-9df1e80f9221 req-9928dd7e-545c-408a-8481-7362f04988d3 tempest-AttachVolumeTestJSON-835086648 None] Deleting attachment bbfa36ed-7af1-433b-9f1c-fffe604244d4. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:43:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "cinder-8d4a0026-af64-470d-85b9-2d53430a61d1-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "cinder-8d4a0026-af64-470d-85b9-2d53430a61d1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "cinder-quobyte-8d4a0026-af64-470d-85b9-2d53430a61d1" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "cinder-quobyte-8d4a0026-af64-470d-85b9-2d53430a61d1" acquired by "delete_volume" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:26 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3570dac7-866e-48d6-ac9f-9cc97169e41f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:26 devstack sudo[97557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1
Jul 07 22:43:26 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:27 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1" returned: 0 in 1.050s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:27 devstack sudo[97580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1
Jul 07 22:43:27 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:28 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8d4a0026-af64-470d-85b9-2d53430a61d1" returned: 0 in 0.717s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "cinder-quobyte-8d4a0026-af64-470d-85b9-2d53430a61d1" released by "delete_volume" :: held 1.807s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Created reservations ['c6a5acfd-4b63-49c8-94af-9404962e6652', 'd980e8e8-dffa-4f23-aa9b-2d4eec47e3f5', '8c45cb93-d73f-4db1-ba8a-a7834a0d0f96', '8f5137d6-88af-43ae-ad96-9f070acb2d12'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:28 devstack sudo[97585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:28 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "cinder-200ab4c3-7e65-4617-8115-fea32f23a7b7-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "cinder-200ab4c3-7e65-4617-8115-fea32f23a7b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "cinder-quobyte-200ab4c3-7e65-4617-8115-fea32f23a7b7" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "cinder-quobyte-200ab4c3-7e65-4617-8115-fea32f23a7b7" acquired by "delete_volume" :: waited 0.033s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:29 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4142f8a8-3fac-4851-8678-7e542f3675d7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:29 devstack sudo[97587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7
Jul 07 22:43:29 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:29 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.754s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:29 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:29 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Deleted volume successfully.
Jul 07 22:43:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-803b31ea-fbc1-4b2c-9ba3-fa23f1a0a8bb tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "cinder-8d4a0026-af64-470d-85b9-2d53430a61d1-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:29 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7" returned: 0 in 0.847s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:30 devstack sudo[97593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7
Jul 07 22:43:30 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (5829755e-fd0d-4c7b-ab6c-e34e4ef391de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af485047-747b-4de3-a577-8dbb5a11172b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af485047-747b-4de3-a577-8dbb5a11172b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1071908791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68046c6a-081d-4a4c-8676-c03ddd00a9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:30Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c606347f-0efb-4630-be61-a74271fd8043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c606347f-0efb-4630-be61-a74271fd8043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c96dd99-1b40-4973-acc5-fa12e67a4141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c96dd99-1b40-4973-acc5-fa12e67a4141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68046c6a-081d-4a4c-8676-c03ddd00a9f6', 'volume_name': 'volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72261bcb-5664-497d-b31a-001d8139ca2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72261bcb-5664-497d-b31a-001d8139ca2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9126e227-810b-49ac-b7f5-9476c315ecab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:30 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Volume 68046c6a-081d-4a4c-8676-c03ddd00a9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6', 'volume_size': 1}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1071908791',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68046c6a-081d-4a4c-8676-c03ddd00a9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:30Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Creating volume 68046c6a-081d-4a4c-8676-c03ddd00a9f6 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:30 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:30 devstack sudo[97596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6 1073741824
Jul 07 22:43:30 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:30 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-200ab4c3-7e65-4617-8115-fea32f23a7b7" returned: 0 in 0.733s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "cinder-quobyte-200ab4c3-7e65-4617-8115-fea32f23a7b7" released by "delete_volume" :: held 1.638s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Created reservations ['c60b4bf0-0b23-45f6-a368-a545cf36102e', '2f91a1b0-a70d-4eba-9f39-dbe4606ff351', '58b7fd1b-8ed9-49af-9f43-6723c8969ed8', 'd1b15f30-10dd-4874-9682-55dfda58a56a'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:30 devstack sudo[97599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:30 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:31 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6 1073741824" returned: 0 in 0.950s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:31 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6
Jul 07 22:43:31 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:31 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.737s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:31 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:31 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Deleted volume successfully.
Jul 07 22:43:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2967f14-6b14-4bdb-882e-590493b7ee80 tempest-TestServerVolumeAttachmentScenario-1804836504 None] Lock "cinder-200ab4c3-7e65-4617-8115-fea32f23a7b7-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:32 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6" returned: 0 in 0.723s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9126e227-810b-49ac-b7f5-9476c315ecab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559cb5eb-76e5-4525-87a7-c156e86167a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:32 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Volume volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6 (68046c6a-081d-4a4c-8676-c03ddd00a9f6): created successfully
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (559cb5eb-76e5-4525-87a7-c156e86167a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (5829755e-fd0d-4c7b-ab6c-e34e4ef391de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-76da99e2-8910-46b0-a6fe-dea6998e4d5b tempest-VolumesActionsTest-1156477007 None] Created volume successfully.
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Acquiring lock "cinder-68046c6a-081d-4a4c-8676-c03ddd00a9f6-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Lock "cinder-68046c6a-081d-4a4c-8676-c03ddd00a9f6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Acquiring lock "cinder-quobyte-68046c6a-081d-4a4c-8676-c03ddd00a9f6" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Lock "cinder-quobyte-68046c6a-081d-4a4c-8676-c03ddd00a9f6" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5162a784-0fc5-4cce-86a3-d7bcd9c52aba]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:32 devstack sudo[97608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6
Jul 07 22:43:32 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:33 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6" returned: 0 in 0.946s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:33 devstack sudo[97614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6
Jul 07 22:43:33 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "cinder-dc9595a2-4227-4287-ae12-0869c18914fa-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-dc9595a2-4227-4287-ae12-0869c18914fa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "cinder-quobyte-dc9595a2-4227-4287-ae12-0869c18914fa" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-quobyte-dc9595a2-4227-4287-ae12-0869c18914fa" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:33 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[31da2428-fae2-479c-810a-4f884b2acdc9]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:33 devstack sudo[97616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa
Jul 07 22:43:33 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:34 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-68046c6a-081d-4a4c-8676-c03ddd00a9f6" returned: 0 in 0.755s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Lock "cinder-quobyte-68046c6a-081d-4a4c-8676-c03ddd00a9f6" released by "delete_volume" :: held 1.765s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Created reservations ['9de337f1-3332-471a-8f82-d8ceb301ccaf', 'f690ee8c-40f9-4baf-adda-b7cfb568469d', '9b795ac5-f9aa-40a3-b207-8bb4c7923b91', 'd516fbfa-1bd4-42aa-b1ce-c92d3045f7e7'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:34 devstack sudo[97619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:34 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:34 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa" returned: 0 in 1.045s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:34 devstack sudo[97624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa
Jul 07 22:43:34 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:35 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.852s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:35 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Deleted volume successfully.
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f05054c0-9cd4-47bf-8be7-b5cf96c901d9 tempest-VolumesActionsTest-423721168 None] Lock "cinder-68046c6a-081d-4a4c-8676-c03ddd00a9f6-delete_volume" released by "delete_volume" :: held 2.894s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (6d6507a9-8071-4a65-9b9f-e02d8443b9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1671924-3495-40f8-a166-91ac1a9cf091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1671924-3495-40f8-a166-91ac1a9cf091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1965854064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81399675-9f58-4a58-a3ab-d9e37a73ce21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:35Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2435723-e5ef-4c44-9359-d3e7651480c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2435723-e5ef-4c44-9359-d3e7651480c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f36d642-bd5c-4ae8-bb81-6de38d9e66ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f36d642-bd5c-4ae8-bb81-6de38d9e66ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81399675-9f58-4a58-a3ab-d9e37a73ce21', 'volume_name': 'volume-81399675-9f58-4a58-a3ab-d9e37a73ce21', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a965aa37-8efc-417e-87c8-cdfff6f3833b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a965aa37-8efc-417e-87c8-cdfff6f3833b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d981d7-f188-4d64-997f-98b9596d46a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:35 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Volume 81399675-9f58-4a58-a3ab-d9e37a73ce21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81399675-9f58-4a58-a3ab-d9e37a73ce21', 'volume_size': 1}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1965854064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81399675-9f58-4a58-a3ab-d9e37a73ce21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:35Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Creating volume 81399675-9f58-4a58-a3ab-d9e37a73ce21 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:35 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:35 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21 1073741824
Jul 07 22:43:35 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:35 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-dc9595a2-4227-4287-ae12-0869c18914fa" returned: 0 in 0.832s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-quobyte-dc9595a2-4227-4287-ae12-0869c18914fa" released by "delete_volume" :: held 1.933s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Created reservations ['04b46cff-1d1f-46b4-b675-83a747bce86c', '740c2b71-e8b5-4e77-bee1-53a3dc541a96', '864ad661-4a8d-4305-8e24-0add6c5e86cf', 'a7b74469-270c-45be-a6d7-4b806d06f6cc'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:35 devstack sudo[97631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:35 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "cinder-50072ec4-f083-40de-a9eb-a82058e3d9e5-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-50072ec4-f083-40de-a9eb-a82058e3d9e5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "cinder-quobyte-50072ec4-f083-40de-a9eb-a82058e3d9e5" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-quobyte-50072ec4-f083-40de-a9eb-a82058e3d9e5" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:36 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[636ec5f5-121a-4912-904b-34a2194ab4ea]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:36 devstack sudo[97633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5
Jul 07 22:43:36 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:36 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.789s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:36 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:36 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Deleted volume successfully.
Jul 07 22:43:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ef9934e0-d59c-488a-9dbe-1af8c459e870 tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-dc9595a2-4227-4287-ae12-0869c18914fa-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:36 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21 1073741824" returned: 0 in 1.202s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:36 devstack sudo[97640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21
Jul 07 22:43:36 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:37 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5" returned: 0 in 0.954s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:37 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5
Jul 07 22:43:37 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:37 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21" returned: 0 in 0.734s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d981d7-f188-4d64-997f-98b9596d46a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81399675-9f58-4a58-a3ab-d9e37a73ce21', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f6a746-0636-4ce9-8531-34164c3e4a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:37 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Volume volume-81399675-9f58-4a58-a3ab-d9e37a73ce21 (81399675-9f58-4a58-a3ab-d9e37a73ce21): created successfully
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f6a746-0636-4ce9-8531-34164c3e4a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (6d6507a9-8071-4a65-9b9f-e02d8443b9db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a0a8aa0b-a625-47bd-9734-bd2591e4469a tempest-VolumesActionsTest-1156477007 None] Created volume successfully.
Jul 07 22:43:37 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-50072ec4-f083-40de-a9eb-a82058e3d9e5" returned: 0 in 0.685s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-quobyte-50072ec4-f083-40de-a9eb-a82058e3d9e5" released by "delete_volume" :: held 1.685s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Created reservations ['0c2e3bea-d387-47f1-9524-c63dfa020611', '78d74df3-b4d0-4e19-bdc8-cdcdf7e10d67', 'f86b74b6-a7e6-46a8-92e9-68923f76ffc8', '269e1fed-8c59-4276-8147-95122bb51374'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:37 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:37 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "cinder-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "cinder-quobyte-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-quobyte-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a596c3-0870-4429-afd1-a1b5cf31c99d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:38 devstack sudo[97654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3
Jul 07 22:43:38 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:38 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.812s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:38 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Deleted volume successfully.
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80dbe042-991a-4e98-8399-a305b87d3e00 tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-50072ec4-f083-40de-a9eb-a82058e3d9e5-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Acquiring lock "cinder-81399675-9f58-4a58-a3ab-d9e37a73ce21-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Lock "cinder-81399675-9f58-4a58-a3ab-d9e37a73ce21-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Acquiring lock "cinder-quobyte-81399675-9f58-4a58-a3ab-d9e37a73ce21" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Lock "cinder-quobyte-81399675-9f58-4a58-a3ab-d9e37a73ce21" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f91784-c1fa-45d2-b9cc-0fb027f4af80]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:39 devstack sudo[97657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21
Jul 07 22:43:39 devstack sudo[97657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:39 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3" returned: 0 in 0.952s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:39 devstack sudo[97662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3
Jul 07 22:43:39 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:39 devstack sudo[97657]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21" returned: 0 in 0.882s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:39 devstack sudo[97668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21
Jul 07 22:43:39 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:40 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3" returned: 0 in 0.758s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-quobyte-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3" released by "delete_volume" :: held 1.791s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Created reservations ['0e4a1193-c998-4816-97cc-cbd188595924', 'e2ee916f-0eb2-4f58-a553-fee9e25e4e51', 'b52ead26-315a-41f3-af03-01895473c515', '357a057c-1a50-42e7-a0b6-9c76dfc82b13'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:40 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:40 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:40 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-81399675-9f58-4a58-a3ab-d9e37a73ce21" returned: 0 in 0.806s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Lock "cinder-quobyte-81399675-9f58-4a58-a3ab-d9e37a73ce21" released by "delete_volume" :: held 1.740s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Created reservations ['da739f26-f762-40dd-87cc-e31372bc37fe', '9399a94a-f4b4-4982-b9ed-f0088017576a', '91be29a6-1a23-4d4c-b253-6d6f7f5ce08b', '3f9b7cdc-7ec5-4d92-96a3-c8f2fa995492'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:40 devstack sudo[97675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:40 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:41 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.882s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:41 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Deleted volume successfully.
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-94a48fbf-1814-4b26-9074-83e1e6ba9aac tempest-AttachVolumeTestJSON-835086648 None] Lock "cinder-11e4d6db-975b-47f9-a13a-8f0ab3f8f9c3-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:41 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (2dc78324-2188-49b2-9bd8-c83e2c47b355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19917cbe-e254-4bcd-b31c-7271036a1682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.030s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:41 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Deleted volume successfully.
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19917cbe-e254-4bcd-b31c-7271036a1682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-303842782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb644bc7-ae9d-4264-b8d0-17c527d62215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:42Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11aa2f02-f062-4b31-8571-01ecb0446b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11aa2f02-f062-4b31-8571-01ecb0446b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3e9ec0-b893-4e42-9a8e-47d6271034b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3e9ec0-b893-4e42-9a8e-47d6271034b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb644bc7-ae9d-4264-b8d0-17c527d62215', 'volume_name': 'volume-eb644bc7-ae9d-4264-b8d0-17c527d62215', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdabc59f-2eec-4f73-a545-cc38d6b26ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdabc59f-2eec-4f73-a545-cc38d6b26ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cc0445-8638-4932-91c9-fb72df6ae188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:41 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Volume eb644bc7-ae9d-4264-b8d0-17c527d62215: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb644bc7-ae9d-4264-b8d0-17c527d62215', 'volume_size': 1}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-303842782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb644bc7-ae9d-4264-b8d0-17c527d62215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:42Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Creating volume eb644bc7-ae9d-4264-b8d0-17c527d62215 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:41 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:41 devstack sudo[97679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215 1073741824
Jul 07 22:43:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ca71b93-538c-4bdf-91c0-cd1cbc8f8b1e tempest-VolumesActionsTest-423721168 None] Lock "cinder-81399675-9f58-4a58-a3ab-d9e37a73ce21-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:41 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:42 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215 1073741824" returned: 0 in 1.047s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:43 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215
Jul 07 22:43:43 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:43 devstack sudo[97691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:43 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:43 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215" returned: 0 in 0.702s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47cc0445-8638-4932-91c9-fb72df6ae188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb644bc7-ae9d-4264-b8d0-17c527d62215', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1a608f-ebc6-4125-825e-88c6987b784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:43 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Volume volume-eb644bc7-ae9d-4264-b8d0-17c527d62215 (eb644bc7-ae9d-4264-b8d0-17c527d62215): created successfully
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a1a608f-ebc6-4125-825e-88c6987b784e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (2dc78324-2188-49b2-9bd8-c83e2c47b355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-727dfbbf-cfa8-44f7-886e-cb2451625ba3 tempest-VolumesActionsTest-1156477007 None] Created volume successfully.
Jul 07 22:43:44 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.803s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:43:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 28 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:43:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:43:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Acquiring lock "cinder-eb644bc7-ae9d-4264-b8d0-17c527d62215-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Lock "cinder-eb644bc7-ae9d-4264-b8d0-17c527d62215-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Acquiring lock "cinder-quobyte-eb644bc7-ae9d-4264-b8d0-17c527d62215" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Lock "cinder-quobyte-eb644bc7-ae9d-4264-b8d0-17c527d62215" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:45 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[724b31a0-0172-47cd-ab7f-4bdb7fd15b97]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:45 devstack sudo[97699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215
Jul 07 22:43:45 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:46 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215" returned: 0 in 0.821s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:46 devstack sudo[97705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215
Jul 07 22:43:46 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:46 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-eb644bc7-ae9d-4264-b8d0-17c527d62215" returned: 0 in 0.757s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Lock "cinder-quobyte-eb644bc7-ae9d-4264-b8d0-17c527d62215" released by "delete_volume" :: held 1.632s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:46 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=84,cinder:UPDATE=96,cinder:DELETE=7,cinder:INSERT=16 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:43:46 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Created reservations ['34b52833-b756-422f-948b-98ed26833568', '439a8594-e9c7-4119-ad62-b2b72d9588f1', '93f9bf53-7c9d-47c0-9ca0-9cc7ac19c8b1', '1d855904-24ad-4624-a44b-3b53d15e6aaf'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:47 devstack sudo[97708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:47 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:47 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.842s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:47 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Deleted volume successfully.
Jul 07 22:43:47 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-649459b1-6350-4656-a0e3-6703de78cce0 tempest-VolumesActionsTest-423721168 None] Lock "cinder-eb644bc7-ae9d-4264-b8d0-17c527d62215-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Flow 'volume_create_manager' (741df014-7f2b-41f6-a2b4-e209aa5f1f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408428ec-0c41-43f7-98c7-d0d55d020b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408428ec-0c41-43f7-98c7-d0d55d020b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1739c78-4f57-497d-98f6-030933c8607c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a878faa8a0642ea802c24547986d8a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:48Z,use_quota=True,user_id='cc0f866407654a8cbd95c6ac5849d328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9b55380-db27-4133-9c9a-a583c57e8a1e),volume_type_id=e9b55380-db27-4133-9c9a-a583c57e8a1e)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec62bf7c-5c30-4514-bf38-5540d3541958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec62bf7c-5c30-4514-bf38-5540d3541958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e4b57d-3b61-4cfa-addb-5f7a4a973d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.image.glance [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Creating Keystone auth plugin from conf {{(pid=88077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (826ae9f0-440f-4335-bdee-bcf9d351ff3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a9744f-2986-4bef-b562-de928a080270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a9744f-2986-4bef-b562-de928a080270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1304468569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c164bde6-d1ed-456a-8e99-1bbaa88044a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:48Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173b056a-94af-43fb-a998-e4366beeb06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (173b056a-94af-43fb-a998-e4366beeb06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b58b5b-45c5-4395-b360-e4e12e9b885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9b58b5b-45c5-4395-b360-e4e12e9b885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c164bde6-d1ed-456a-8e99-1bbaa88044a1', 'volume_name': 'volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b35569a-bc5b-4cb9-b9ac-57e324f42c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b35569a-bc5b-4cb9-b9ac-57e324f42c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ec5265-9e41-46d1-8445-bfbddf6f78bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:48 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Volume c164bde6-d1ed-456a-8e99-1bbaa88044a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1', 'volume_size': 1}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1304468569',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c164bde6-d1ed-456a-8e99-1bbaa88044a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:48Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Creating volume c164bde6-d1ed-456a-8e99-1bbaa88044a1 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:48 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:48 devstack sudo[97713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1 1073741824
Jul 07 22:43:48 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e4b57d-3b61-4cfa-addb-5f7a4a973d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1739c78-4f57-497d-98f6-030933c8607c', 'volume_name': 'volume-c1739c78-4f57-497d-98f6-030933c8607c', 'volume_size': 1, 'image_id': 'e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b8c1855a0415d5f9537b3fb3791085b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a878faa8a0642ea802c24547986d8a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6c4c10d412082b438680b1fc9763f64d3987b65d58be10c370a4e805bc350643fb2cd8d8b1908fd463ab5fd3070c135cef644383f707be5c15c6f8c615da879', 'id': 'e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'created_at': datetime.datetime(2026, 7, 7, 20, 43, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 43, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e828cb6c-73b7-4570-be65-9cf8c36ae9e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72a4fec0>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63b69f9-7096-4086-8747-0b8716c7cff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d63b69f9-7096-4086-8747-0b8716c7cff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952a16ed-e0c7-49b6-817e-61e719e1026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:48 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Volume c1739c78-4f57-497d-98f6-030933c8607c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1739c78-4f57-497d-98f6-030933c8607c', 'volume_size': 1, 'image_id': 'e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b8c1855a0415d5f9537b3fb3791085b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a878faa8a0642ea802c24547986d8a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6c4c10d412082b438680b1fc9763f64d3987b65d58be10c370a4e805bc350643fb2cd8d8b1908fd463ab5fd3070c135cef644383f707be5c15c6f8c615da879', 'id': 'e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'created_at': datetime.datetime(2026, 7, 7, 20, 43, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 43, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e828cb6c-73b7-4570-be65-9cf8c36ae9e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72a4fec0>}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Trying to clone c1739c78-4f57-497d-98f6-030933c8607c from image e828cb6c-73b7-4570-be65-9cf8c36ae9e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'metadata': {}}]). {{(pid=88077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:43:48 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c658ff99-ef79-4fdf-8324-0b345d9aad3c]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:49 devstack sudo[97715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD
Jul 07 22:43:49 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:49 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1 1073741824" returned: 0 in 1.023s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:49 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=101,cinder:UPDATE=99,cinder:INSERT=26,cinder:DELETE=7 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:43:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:49 devstack sudo[97721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1
Jul 07 22:43:49 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:49 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD" returned: 0 in 0.869s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:49 devstack sudo[97725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD
Jul 07 22:43:49 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:50 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1" returned: 0 in 0.737s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] <== create_volume: return (1821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ec5265-9e41-46d1-8445-bfbddf6f78bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4545e01c-edcd-4128-ac4a-fc127b45275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:50 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Volume volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1 (c164bde6-d1ed-456a-8e99-1bbaa88044a1): created successfully
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4545e01c-edcd-4128-ac4a-fc127b45275d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (826ae9f0-440f-4335-bdee-bcf9d351ff3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:50 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5a7fe284-2879-437b-986f-d0740c763d68 tempest-VolumesActionsTest-1156477007 None] Created volume successfully.
Jul 07 22:43:50 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD" returned: 1 in 0.786s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Temporary image e828cb6c-73b7-4570-be65-9cf8c36ae9e0 is fetched for user cc0f866407654a8cbd95c6ac5849d328. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d3f171-6147-4abf-a5b9-95f866be6625]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:50 devstack sudo[97732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD
Jul 07 22:43:50 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Acquiring lock "cinder-c164bde6-d1ed-456a-8e99-1bbaa88044a1-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Lock "cinder-c164bde6-d1ed-456a-8e99-1bbaa88044a1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Acquiring lock "cinder-quobyte-c164bde6-d1ed-456a-8e99-1bbaa88044a1" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:51 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD" returned: 0 in 0.868s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Lock "cinder-quobyte-c164bde6-d1ed-456a-8e99-1bbaa88044a1" acquired by "delete_volume" :: waited 0.033s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:51 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[717cb7d9-5310-467b-8599-c488dfc2040a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:51 devstack sudo[97736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD
Jul 07 22:43:51 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:51 devstack sudo[97737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1
Jul 07 22:43:51 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:52 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD" returned: 1 in 0.801s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1739c78-4f57-497d-98f6-030933c8607c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a878faa8a0642ea802c24547986d8a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:48Z,use_quota=True,user_id='cc0f866407654a8cbd95c6ac5849d328',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9b55380-db27-4133-9c9a-a583c57e8a1e),volume_type_id=e9b55380-db27-4133-9c9a-a583c57e8a1e)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Creating volume c1739c78-4f57-497d-98f6-030933c8607c {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:52 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:52 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c 1073741824
Jul 07 22:43:52 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:52 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1" returned: 0 in 0.808s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:52 devstack sudo[97748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1
Jul 07 22:43:52 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:53 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c164bde6-d1ed-456a-8e99-1bbaa88044a1" returned: 0 in 0.796s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Lock "cinder-quobyte-c164bde6-d1ed-456a-8e99-1bbaa88044a1" released by "delete_volume" :: held 1.665s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Created reservations ['809afc2e-2300-47f0-8a9f-c90525deb136', '5502a71e-5052-458b-8288-12c4a1cb97b1', '292e3c38-6ef9-440c-9fd0-48f33d5a78a5', '323a71b2-8e3b-4d9d-a2d6-b7db0c136871'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:53 devstack sudo[97756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:43:53 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:53 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c 1073741824" returned: 0 in 1.149s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:53 devstack sudo[97758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c
Jul 07 22:43:53 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:54 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.819s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:54 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Deleted volume successfully.
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a72869dd-bfd0-4719-a995-68ad5c3ab600 tempest-VolumesActionsTest-423721168 None] Lock "cinder-c164bde6-d1ed-456a-8e99-1bbaa88044a1-delete_volume" released by "delete_volume" :: held 2.823s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:54 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c" returned: 0 in 0.813s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Attempting download of e828cb6c-73b7-4570-be65-9cf8c36ae9e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'metadata': {}}])) to volume c1739c78-4f57-497d-98f6-030933c8607c. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (e7227b23-fd65-4ada-8fd7-6f284040a9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e454ab-2120-46c7-9c8b-61a2dbd4ed7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[493c2187-7e79-4c04-adaf-81d1e9cab066]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_osxsfudc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e454ab-2120-46c7-9c8b-61a2dbd4ed7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-935775604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e0e982-f975-470d-bf24-2cfc147bb673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:54Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce80da9-9c80-4477-bafa-c47c140dabfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce80da9-9c80-4477-bafa-c47c140dabfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df5f324-d641-44eb-8e46-600936ddbdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df5f324-d641-44eb-8e46-600936ddbdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e0e982-f975-470d-bf24-2cfc147bb673', 'volume_name': 'volume-c3e0e982-f975-470d-bf24-2cfc147bb673', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d23ba6d-25c8-4b41-b4be-0631a945b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d23ba6d-25c8-4b41-b4be-0631a945b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bad7ba5-021d-477a-b1dc-6841c2075272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:54 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Volume c3e0e982-f975-470d-bf24-2cfc147bb673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e0e982-f975-470d-bf24-2cfc147bb673', 'volume_size': 1}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-935775604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e0e982-f975-470d-bf24-2cfc147bb673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f380ffb68b224cb3809a76aae8275887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:54Z,use_quota=True,user_id='29d1c159ddd44dd589289974312c490c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Creating volume c3e0e982-f975-470d-bf24-2cfc147bb673 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:54 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:43:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:54 devstack sudo[97763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673 1073741824
Jul 07 22:43:54 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:54 devstack sudo[97762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_osxsfudc
Jul 07 22:43:54 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:55 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_osxsfudc" returned: 0 in 0.839s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_osxsfudc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:55 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_osxsfudc
Jul 07 22:43:55 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:55 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673 1073741824" returned: 0 in 1.000s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:55 devstack sudo[97774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673
Jul 07 22:43:55 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:56 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_osxsfudc" returned: 1 in 0.846s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_osxsfudc' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6455f0a3-7440-449e-9778-0041c814db4d]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:56 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD
Jul 07 22:43:56 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:56 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673" returned: 0 in 0.743s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bad7ba5-021d-477a-b1dc-6841c2075272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e0e982-f975-470d-bf24-2cfc147bb673', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98074c97-8d64-40d1-acc8-ed4e85463a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:56 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Volume volume-c3e0e982-f975-470d-bf24-2cfc147bb673 (c3e0e982-f975-470d-bf24-2cfc147bb673): created successfully
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98074c97-8d64-40d1-acc8-ed4e85463a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Flow 'volume_create_manager' (e7227b23-fd65-4ada-8fd7-6f284040a9a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6730898b-12fb-4383-a957-edbca41b4444 tempest-VolumesActionsTest-1156477007 None] Created volume successfully.
Jul 07 22:43:56 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD" returned: 0 in 0.826s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:57 devstack sudo[97783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD
Jul 07 22:43:57 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:57 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD" returned: 1 in 0.792s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:43:57 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] e828cb6c-73b7-4570-be65-9cf8c36ae9e0 was raw, converting to raw {{(pid=88077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:43:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:57 devstack sudo[97788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c
Jul 07 22:43:57 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "cinder-c3e0e982-f975-470d-bf24-2cfc147bb673-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Lock "cinder-c3e0e982-f975-470d-bf24-2cfc147bb673-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "cinder-quobyte-c3e0e982-f975-470d-bf24-2cfc147bb673" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Lock "cinder-quobyte-c3e0e982-f975-470d-bf24-2cfc147bb673" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:58 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc2b31-c240-42a8-be24-567e7f8ec28c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:58 devstack sudo[97790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673
Jul 07 22:43:58 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:58 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c" returned: 0 in 0.870s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:58 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e828cb6c-73b7-4570-be65-9cf8c36ae9e0_iry7twq6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:43:58 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 22:43:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:58 devstack sudo[97795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c 1G
Jul 07 22:43:58 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:59 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673" returned: 0 in 1.071s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:59 devstack sudo[97804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673
Jul 07 22:43:59 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:59 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c 1G" returned: 0 in 0.840s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:59 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[91285376-7b2c-4800-b321-a20f84333403]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:59 devstack sudo[97806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c
Jul 07 22:43:59 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:00 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c3e0e982-f975-470d-bf24-2cfc147bb673" returned: 0 in 0.679s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Lock "cinder-quobyte-c3e0e982-f975-470d-bf24-2cfc147bb673" released by "delete_volume" :: held 1.808s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Created reservations ['651e5f0f-7758-47a1-a709-4222375243c1', '8170bcec-9629-4f3d-b67b-86853b6a0a06', '29a57abb-959c-498c-b90a-4bf54a04eee9', '0546eb25-547e-4655-b3ce-d7adc4009df0'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:00 devstack sudo[97811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:00 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:00 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c" returned: 0 in 0.835s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:00 devstack sudo[97814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c
Jul 07 22:44:00 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:01 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.804s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Deleted volume successfully.
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-29bb1f2c-64f4-4cb4-82b3-4ca2de2d6a05 tempest-VolumesActionsTest-1156477007 None] Lock "cinder-c3e0e982-f975-470d-bf24-2cfc147bb673-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:01 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c" returned: 1 in 0.960s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Downloaded image e828cb6c-73b7-4570-be65-9cf8c36ae9e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'metadata': {}}])) to volume c1739c78-4f57-497d-98f6-030933c8607c successfully. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Temporary image e828cb6c-73b7-4570-be65-9cf8c36ae9e0 for user cc0f866407654a8cbd95c6ac5849d328 is deleted. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Marking volume c1739c78-4f57-497d-98f6-030933c8607c as bootable. {{(pid=88077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Copying metadata from image e828cb6c-73b7-4570-be65-9cf8c36ae9e0 to c1739c78-4f57-497d-98f6-030933c8607c. {{(pid=88077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Creating volume glance metadata for volume c1739c78-4f57-497d-98f6-030933c8607c backed by image e828cb6c-73b7-4570-be65-9cf8c36ae9e0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b8c1855a0415d5f9537b3fb3791085b4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (952a16ed-e0c7-49b6-817e-61e719e1026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1739c78-4f57-497d-98f6-030933c8607c', 'volume_size': 1, 'image_id': 'e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b8c1855a0415d5f9537b3fb3791085b4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a878faa8a0642ea802c24547986d8a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f6c4c10d412082b438680b1fc9763f64d3987b65d58be10c370a4e805bc350643fb2cd8d8b1908fd463ab5fd3070c135cef644383f707be5c15c6f8c615da879', 'id': 'e828cb6c-73b7-4570-be65-9cf8c36ae9e0', 'created_at': datetime.datetime(2026, 7, 7, 20, 43, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 43, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e828cb6c-73b7-4570-be65-9cf8c36ae9e0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72a4fec0>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99a850b-b94a-4d20-9f8c-6dc0942af9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:01 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Volume volume-c1739c78-4f57-497d-98f6-030933c8607c (c1739c78-4f57-497d-98f6-030933c8607c): created successfully
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a99a850b-b94a-4d20-9f8c-6dc0942af9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Flow 'volume_create_manager' (741df014-7f2b-41f6-a2b4-e209aa5f1f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0f4a4316-492b-4396-81dd-f8c88b646508 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Created volume successfully.
Jul 07 22:44:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Acquiring lock "cinder-c1739c78-4f57-497d-98f6-030933c8607c-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Lock "cinder-c1739c78-4f57-497d-98f6-030933c8607c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Acquiring lock "cinder-quobyte-c1739c78-4f57-497d-98f6-030933c8607c" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Lock "cinder-quobyte-c1739c78-4f57-497d-98f6-030933c8607c" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b3b9f5-1984-4122-9679-04f056d24706]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:02 devstack sudo[97821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c
Jul 07 22:44:02 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:03 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c" returned: 0 in 0.885s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:03 devstack sudo[97828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c
Jul 07 22:44:03 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:04 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c" returned: 1 in 0.992s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:44:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:04 devstack sudo[97833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c
Jul 07 22:44:04 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:04 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c1739c78-4f57-497d-98f6-030933c8607c" returned: 0 in 0.746s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Lock "cinder-quobyte-c1739c78-4f57-497d-98f6-030933c8607c" released by "delete_volume" :: held 2.733s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:05 devstack cinder-volume[88077]: WARNING cinder.quota [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:44:05 devstack cinder-volume[88077]: WARNING cinder.quota [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Created reservations ['c2a1eed9-d2fa-4d0f-afe1-8b357262b0fd', '0332f8da-59dd-4021-9161-af07804be3d3', 'af676291-9358-4922-958d-ac22e723684b', 'ea91d6e4-ac6d-4585-8273-5146be9e74b9'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:05 devstack sudo[97837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:05 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:05 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.739s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:05 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:06 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Deleted volume successfully.
Jul 07 22:44:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-dfbfd2df-3229-40e3-b0a4-6ddf4b5c91c0 tempest-VolumeAndVolumeTypeFromImageTest-2036464544 None] Lock "cinder-c1739c78-4f57-497d-98f6-030933c8607c-delete_volume" released by "delete_volume" :: held 3.810s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Flow 'volume_create_manager' (b4502f36-22cb-420a-904a-ec93ed3d04f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d987f78-9279-4f2b-94b6-160fcf9afdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d987f78-9279-4f2b-94b6-160fcf9afdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-871303976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60e7b91-ebc6-45ca-822b-d874b0375b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef91fc9c1be453ea474b4c758cc784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:12Z,use_quota=True,user_id='fd82519e78034b31a400f4a1f8cc6709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2705fbbe-0043-4c6c-9fd4-4222dc6198fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2705fbbe-0043-4c6c-9fd4-4222dc6198fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e28fd2-7983-466f-9dd1-584f19d7abb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e28fd2-7983-466f-9dd1-584f19d7abb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b60e7b91-ebc6-45ca-822b-d874b0375b19', 'volume_name': 'volume-b60e7b91-ebc6-45ca-822b-d874b0375b19', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f678702-286a-49f0-a5cb-10fe103d920c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f678702-286a-49f0-a5cb-10fe103d920c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4effc92b-ad0d-4765-9357-c7f6c03e1140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:11 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Volume b60e7b91-ebc6-45ca-822b-d874b0375b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b60e7b91-ebc6-45ca-822b-d874b0375b19', 'volume_size': 1}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-871303976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60e7b91-ebc6-45ca-822b-d874b0375b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef91fc9c1be453ea474b4c758cc784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:12Z,use_quota=True,user_id='fd82519e78034b31a400f4a1f8cc6709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Creating volume b60e7b91-ebc6-45ca-822b-d874b0375b19 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:11 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:11 devstack sudo[97863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19 1073741824
Jul 07 22:44:11 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Flow 'volume_create_manager' (7536dd52-8bf5-4d43-9545-ff6c4b79b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de9eacf-155c-4c97-a739-c2adbfb32511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de9eacf-155c-4c97-a739-c2adbfb32511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2009140114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f99869e-ffde-48bc-818b-2ba95109c2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef91fc9c1be453ea474b4c758cc784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:12Z,use_quota=True,user_id='fd82519e78034b31a400f4a1f8cc6709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0d552c-0687-41a6-96f6-f1d13b2a033d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf0d552c-0687-41a6-96f6-f1d13b2a033d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b56c7f-ef1e-4db8-b83d-1743e98e178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95b56c7f-ef1e-4db8-b83d-1743e98e178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f99869e-ffde-48bc-818b-2ba95109c2f9', 'volume_name': 'volume-6f99869e-ffde-48bc-818b-2ba95109c2f9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd88f41d-c816-478b-84f0-8a909ef75835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd88f41d-c816-478b-84f0-8a909ef75835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b64110-e289-433c-8f4b-4d4874dca5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:12 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Volume 6f99869e-ffde-48bc-818b-2ba95109c2f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f99869e-ffde-48bc-818b-2ba95109c2f9', 'volume_size': 1}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Flow 'volume_create_manager' (43bd7fee-cd22-485b-9ecd-da4b04e59c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6acd20c2-703f-4183-9352-b8b733a1031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6acd20c2-703f-4183-9352-b8b733a1031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2042006805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2623a9-3e74-4307-a1be-0785491db124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef91fc9c1be453ea474b4c758cc784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:13Z,use_quota=True,user_id='fd82519e78034b31a400f4a1f8cc6709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e2e478-abe8-481f-9cb6-a00a3d72fc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e2e478-abe8-481f-9cb6-a00a3d72fc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcb1a94-5ef4-4146-a85e-1f83826c3f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dcb1a94-5ef4-4146-a85e-1f83826c3f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2623a9-3e74-4307-a1be-0785491db124', 'volume_name': 'volume-6e2623a9-3e74-4307-a1be-0785491db124', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb6d01a-d99a-4c74-97a0-6e58da532fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cb6d01a-d99a-4c74-97a0-6e58da532fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55797f5-285a-491b-8e8b-c7ff5427c5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:12 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Volume 6e2623a9-3e74-4307-a1be-0785491db124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2623a9-3e74-4307-a1be-0785491db124', 'volume_size': 1}
Jul 07 22:44:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:13 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19 1073741824" returned: 0 in 1.197s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:13 devstack sudo[97870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:13 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Flow 'volume_create_manager' (443ba7e5-b7d9-43ff-ae4f-f25209853ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abdf0ed-6583-489b-95cc-d8444a5503c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0abdf0ed-6583-489b-95cc-d8444a5503c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-714492367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11c0b29-a321-4ee7-bd56-bd074c927fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef91fc9c1be453ea474b4c758cc784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:13Z,use_quota=True,user_id='fd82519e78034b31a400f4a1f8cc6709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09bcb94-4b5e-4b0f-be4a-e44c1e8173ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09bcb94-4b5e-4b0f-be4a-e44c1e8173ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e263d4de-dcca-46bc-a29d-38f55df75a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e263d4de-dcca-46bc-a29d-38f55df75a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b11c0b29-a321-4ee7-bd56-bd074c927fd1', 'volume_name': 'volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b5fc03-abc3-4c29-88db-fa44ae4c2e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b5fc03-abc3-4c29-88db-fa44ae4c2e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6f2a71-77cc-46f7-a9a9-3b0553bdee0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:13 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Volume b11c0b29-a321-4ee7-bd56-bd074c927fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1', 'volume_size': 1}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Flow 'volume_create_manager' (3a7036bf-bff1-4ef3-b7ab-ba1bbb3c5688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ccf292-39e3-4bc5-a059-db2e5070c2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ccf292-39e3-4bc5-a059-db2e5070c2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-432367723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba1476b-c905-4bd4-92a8-d5043ef30867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef91fc9c1be453ea474b4c758cc784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:14Z,use_quota=True,user_id='fd82519e78034b31a400f4a1f8cc6709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91286498-0f63-4b3d-9b64-3a9feb604cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91286498-0f63-4b3d-9b64-3a9feb604cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe47288-08fc-4a0d-9c45-c970deb5cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe47288-08fc-4a0d-9c45-c970deb5cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba1476b-c905-4bd4-92a8-d5043ef30867', 'volume_name': 'volume-bba1476b-c905-4bd4-92a8-d5043ef30867', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566f94cd-a4ea-4d19-bacb-43a59ea7d94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566f94cd-a4ea-4d19-bacb-43a59ea7d94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5060ea-494b-48e6-8fac-9ffb3e8021dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:13 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Volume bba1476b-c905-4bd4-92a8-d5043ef30867: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba1476b-c905-4bd4-92a8-d5043ef30867', 'volume_size': 1}
Jul 07 22:44:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:14 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19" returned: 0 in 0.929s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.629s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2009140114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f99869e-ffde-48bc-818b-2ba95109c2f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef91fc9c1be453ea474b4c758cc784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:12Z,use_quota=True,user_id='fd82519e78034b31a400f4a1f8cc6709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Creating volume 6f99869e-ffde-48bc-818b-2ba95109c2f9 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:14 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:14 devstack sudo[97873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9 1073741824
Jul 07 22:44:14 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4effc92b-ad0d-4765-9357-c7f6c03e1140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b60e7b91-ebc6-45ca-822b-d874b0375b19', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dcd1182-4328-4fc6-adfc-7f53615f2e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:14 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Volume volume-b60e7b91-ebc6-45ca-822b-d874b0375b19 (b60e7b91-ebc6-45ca-822b-d874b0375b19): created successfully
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dcd1182-4328-4fc6-adfc-7f53615f2e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Flow 'volume_create_manager' (b4502f36-22cb-420a-904a-ec93ed3d04f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:14 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1f9bf63b-9ae3-40fd-9ba0-ecc9aea1fea6 tempest-CreateVolumesFromImageTest-1480545330 None] Created volume successfully.
Jul 07 22:44:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9 1073741824" returned: 0 in 0.954s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:15 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:15 devstack sudo[97880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9
Jul 07 22:44:15 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:16 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9" returned: 0 in 1.148s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.386s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2042006805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2623a9-3e74-4307-a1be-0785491db124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef91fc9c1be453ea474b4c758cc784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:13Z,use_quota=True,user_id='fd82519e78034b31a400f4a1f8cc6709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Creating volume 6e2623a9-3e74-4307-a1be-0785491db124 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:16 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:16 devstack sudo[97929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124 1073741824
Jul 07 22:44:16 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b64110-e289-433c-8f4b-4d4874dca5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f99869e-ffde-48bc-818b-2ba95109c2f9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae5f451-f88c-4984-b060-c69c1e5d5610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:16 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Volume volume-6f99869e-ffde-48bc-818b-2ba95109c2f9 (6f99869e-ffde-48bc-818b-2ba95109c2f9): created successfully
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae5f451-f88c-4984-b060-c69c1e5d5610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Flow 'volume_create_manager' (7536dd52-8bf5-4d43-9545-ff6c4b79b525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-12b2660a-a31a-406f-b5f3-0f2598b150ef tempest-CreateVolumesFromImageTest-1480545330 None] Created volume successfully.
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Flow 'volume_create_manager' (9557bd2d-1e41-4e80-896b-589ca2a494fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524687c4-556c-4cdf-81a4-89d576a4be59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524687c4-556c-4cdf-81a4-89d576a4be59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1329916287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612892d7-6261-498d-95cf-ca6f6b13de72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c722e824034443fb94e0ef983ae5434e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:16Z,use_quota=True,user_id='b877a03e06f04b1ca0aac564626a6f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8ebb53-7fc3-4469-907f-ef4df3350a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d8ebb53-7fc3-4469-907f-ef4df3350a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b429bdd-cc43-4b62-bf2e-6da7a48a6c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b429bdd-cc43-4b62-bf2e-6da7a48a6c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '612892d7-6261-498d-95cf-ca6f6b13de72', 'volume_name': 'volume-612892d7-6261-498d-95cf-ca6f6b13de72', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a049a79b-3a60-4469-bed9-6e0ee9340815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a049a79b-3a60-4469-bed9-6e0ee9340815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a21564-f915-40dc-83a2-5d7e0493eb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:16 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Volume 612892d7-6261-498d-95cf-ca6f6b13de72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-612892d7-6261-498d-95cf-ca6f6b13de72', 'volume_size': 1}
Jul 07 22:44:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:17 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124 1073741824" returned: 0 in 0.928s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:17 devstack sudo[97990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124
Jul 07 22:44:17 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:17 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124" returned: 0 in 0.682s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.561s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-714492367',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b11c0b29-a321-4ee7-bd56-bd074c927fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef91fc9c1be453ea474b4c758cc784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:13Z,use_quota=True,user_id='fd82519e78034b31a400f4a1f8cc6709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Creating volume b11c0b29-a321-4ee7-bd56-bd074c927fd1 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:17 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:17 devstack sudo[97995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1 1073741824
Jul 07 22:44:17 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55797f5-285a-491b-8e8b-c7ff5427c5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2623a9-3e74-4307-a1be-0785491db124', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d4c5da-40b5-4221-8cff-fb16a69abb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:17 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Volume volume-6e2623a9-3e74-4307-a1be-0785491db124 (6e2623a9-3e74-4307-a1be-0785491db124): created successfully
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76d4c5da-40b5-4221-8cff-fb16a69abb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Flow 'volume_create_manager' (43bd7fee-cd22-485b-9ecd-da4b04e59c75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:17 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a7c217ee-7fdb-4b93-889c-c08d66b5c7fe tempest-CreateVolumesFromImageTest-1480545330 None] Created volume successfully.
Jul 07 22:44:18 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1 1073741824" returned: 0 in 0.964s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:18 devstack sudo[98001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1
Jul 07 22:44:18 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:19 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1" returned: 0 in 0.703s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.726s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-432367723',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba1476b-c905-4bd4-92a8-d5043ef30867,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef91fc9c1be453ea474b4c758cc784e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:14Z,use_quota=True,user_id='fd82519e78034b31a400f4a1f8cc6709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Creating volume bba1476b-c905-4bd4-92a8-d5043ef30867 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:19 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:19 devstack sudo[98004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867 1073741824
Jul 07 22:44:19 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6f2a71-77cc-46f7-a9a9-3b0553bdee0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d176399-57cf-41de-ae9a-1fb69b1e00fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:19 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Volume volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1 (b11c0b29-a321-4ee7-bd56-bd074c927fd1): created successfully
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d176399-57cf-41de-ae9a-1fb69b1e00fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Flow 'volume_create_manager' (443ba7e5-b7d9-43ff-ae4f-f25209853ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:19 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c6209b8a-f8c7-49f0-8172-73acfbb488fe tempest-CreateVolumesFromImageTest-1480545330 None] Created volume successfully.
Jul 07 22:44:20 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867 1073741824" returned: 0 in 1.001s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:20 devstack sudo[98010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867
Jul 07 22:44:20 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:21 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867" returned: 0 in 0.738s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.928s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1329916287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=612892d7-6261-498d-95cf-ca6f6b13de72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c722e824034443fb94e0ef983ae5434e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:16Z,use_quota=True,user_id='b877a03e06f04b1ca0aac564626a6f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Creating volume 612892d7-6261-498d-95cf-ca6f6b13de72 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:21 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5060ea-494b-48e6-8fac-9ffb3e8021dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba1476b-c905-4bd4-92a8-d5043ef30867', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d6cf1e-7364-4ebc-a1e8-4626da0550aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:21 devstack sudo[98014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72 1073741824
Jul 07 22:44:21 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:21 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Volume volume-bba1476b-c905-4bd4-92a8-d5043ef30867 (bba1476b-c905-4bd4-92a8-d5043ef30867): created successfully
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22d6cf1e-7364-4ebc-a1e8-4626da0550aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Flow 'volume_create_manager' (3a7036bf-bff1-4ef3-b7ab-ba1bbb3c5688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:21 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-248e9ee3-03bd-48c9-aac2-8f3605bcaced tempest-CreateVolumesFromImageTest-1480545330 None] Created volume successfully.
Jul 07 22:44:22 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72 1073741824" returned: 0 in 1.018s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:22 devstack sudo[98021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72
Jul 07 22:44:22 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "cinder-bba1476b-c905-4bd4-92a8-d5043ef30867-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-bba1476b-c905-4bd4-92a8-d5043ef30867-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "cinder-quobyte-bba1476b-c905-4bd4-92a8-d5043ef30867" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-quobyte-bba1476b-c905-4bd4-92a8-d5043ef30867" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[843e648a-91e6-479f-af91-2b7add7321cd]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:22 devstack sudo[98023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867
Jul 07 22:44:22 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:23 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72" returned: 0 in 0.827s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a21564-f915-40dc-83a2-5d7e0493eb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-612892d7-6261-498d-95cf-ca6f6b13de72', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e58c72-e48d-4723-b850-c03036e429e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:23 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Volume volume-612892d7-6261-498d-95cf-ca6f6b13de72 (612892d7-6261-498d-95cf-ca6f6b13de72): created successfully
Jul 07 22:44:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e58c72-e48d-4723-b850-c03036e429e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Flow 'volume_create_manager' (9557bd2d-1e41-4e80-896b-589ca2a494fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:23 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0a1c4cd2-c679-4252-a25d-c3b644d62d3d tempest-VolumesListAdminTestJSON-529771024 None] Created volume successfully.
Jul 07 22:44:23 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867" returned: 0 in 0.809s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:23 devstack sudo[98030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867
Jul 07 22:44:23 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:24 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bba1476b-c905-4bd4-92a8-d5043ef30867" returned: 0 in 0.735s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-quobyte-bba1476b-c905-4bd4-92a8-d5043ef30867" released by "delete_volume" :: held 1.598s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Created reservations ['7aceb239-18e8-4b23-a31e-9e6e74757e84', '7654668e-dbb3-47d3-9cef-f52937ffb05d', 'b676bd35-e035-4ee0-b6f2-33419a54461a', '7e3ad328-6569-48df-8391-95a843198d90'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Flow 'volume_create_manager' (3ddbbb58-d690-49e7-9466-0febc6eff4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006c5ea7-e618-4585-b515-77abb729414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006c5ea7-e618-4585-b515-77abb729414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2098239967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c722e824034443fb94e0ef983ae5434e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:24Z,use_quota=True,user_id='b877a03e06f04b1ca0aac564626a6f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6540d23-9ff0-4d9b-add5-013b8cef7bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6540d23-9ff0-4d9b-add5-013b8cef7bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680a521f-8ada-41b9-be97-295db4e834db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680a521f-8ada-41b9-be97-295db4e834db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2', 'volume_name': 'volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e383f4ec-b997-46e6-9fbe-7f222fe8ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e383f4ec-b997-46e6-9fbe-7f222fe8ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8822907-ac9e-4e97-8ade-574906f45f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:24 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Volume 09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2', 'volume_size': 1}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2098239967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c722e824034443fb94e0ef983ae5434e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:24Z,use_quota=True,user_id='b877a03e06f04b1ca0aac564626a6f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Creating volume 09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:24 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:24 devstack sudo[98033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2 1073741824
Jul 07 22:44:24 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:24 devstack sudo[98035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:24 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "cinder-b11c0b29-a321-4ee7-bd56-bd074c927fd1-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-b11c0b29-a321-4ee7-bd56-bd074c927fd1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "cinder-quobyte-b11c0b29-a321-4ee7-bd56-bd074c927fd1" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-quobyte-b11c0b29-a321-4ee7-bd56-bd074c927fd1" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[713a17d8-513f-42f7-a3e2-73a5e0006302]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:25 devstack sudo[98037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1
Jul 07 22:44:25 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:25 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.777s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:25 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Deleted volume successfully.
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5eeaa758-2a44-4d08-be5e-b6dcb3d7aa07 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-bba1476b-c905-4bd4-92a8-d5043ef30867-delete_volume" released by "delete_volume" :: held 2.759s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:25 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2 1073741824" returned: 0 in 1.032s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:25 devstack sudo[98044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2
Jul 07 22:44:25 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:25 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1" returned: 0 in 0.830s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:26 devstack sudo[98049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1
Jul 07 22:44:26 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:26 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2" returned: 0 in 0.662s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8822907-ac9e-4e97-8ade-574906f45f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3323f1-b0d2-431e-8a70-54acf68c4246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:26 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Volume volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2 (09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2): created successfully
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd3323f1-b0d2-431e-8a70-54acf68c4246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Flow 'volume_create_manager' (3ddbbb58-d690-49e7-9466-0febc6eff4e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f8fb2f4d-7199-43fb-86ce-c7cc23484cf7 tempest-VolumesListAdminTestJSON-529771024 None] Created volume successfully.
Jul 07 22:44:26 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b11c0b29-a321-4ee7-bd56-bd074c927fd1" returned: 0 in 0.687s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-quobyte-b11c0b29-a321-4ee7-bd56-bd074c927fd1" released by "delete_volume" :: held 1.570s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Created reservations ['3f890d96-6616-4159-b81e-f74f711fa341', 'a2c98f64-6ef4-45ce-a414-47c396aa26dd', '940ae857-fb75-4fce-9405-31f958714d0f', '16cc9f26-957e-4b34-9981-21738e456230'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:26 devstack sudo[98053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:26 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Flow 'volume_create_manager' (15ac4b56-a58b-4def-a762-e16dcfc68ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3baf601-a7ec-4553-812a-3b38439e5d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "cinder-6e2623a9-3e74-4307-a1be-0785491db124-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3baf601-a7ec-4553-812a-3b38439e5d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1324971657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd343503-df97-496a-a6b8-ed64b3fd2f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c722e824034443fb94e0ef983ae5434e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:27Z,use_quota=True,user_id='b877a03e06f04b1ca0aac564626a6f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a57632-02e2-47fb-9a39-c2ce2cca2424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6a57632-02e2-47fb-9a39-c2ce2cca2424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7408cd-cdd1-4015-be17-f5e5162e2341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b7408cd-cdd1-4015-be17-f5e5162e2341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd343503-df97-496a-a6b8-ed64b3fd2f29', 'volume_name': 'volume-cd343503-df97-496a-a6b8-ed64b3fd2f29', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d9f3de-854d-4d90-96f8-74b7c2e7a72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95d9f3de-854d-4d90-96f8-74b7c2e7a72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b79439-9e41-46f4-a6bf-217a51df411e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:27 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Volume cd343503-df97-496a-a6b8-ed64b3fd2f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd343503-df97-496a-a6b8-ed64b3fd2f29', 'volume_size': 1}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1324971657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd343503-df97-496a-a6b8-ed64b3fd2f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c722e824034443fb94e0ef983ae5434e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:27Z,use_quota=True,user_id='b877a03e06f04b1ca0aac564626a6f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Creating volume cd343503-df97-496a-a6b8-ed64b3fd2f29 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:27 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-6e2623a9-3e74-4307-a1be-0785491db124-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:27 devstack sudo[98055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29 1073741824
Jul 07 22:44:27 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "cinder-quobyte-6e2623a9-3e74-4307-a1be-0785491db124" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-quobyte-6e2623a9-3e74-4307-a1be-0785491db124" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab20f1f-9efe-4399-8453-ebb8bacfc62e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:27 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.755s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Deleted volume successfully.
Jul 07 22:44:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8eb837d-a603-4152-ae47-974ad15134f2 tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-b11c0b29-a321-4ee7-bd56-bd074c927fd1-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:27 devstack sudo[98058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124
Jul 07 22:44:27 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:28 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29 1073741824" returned: 0 in 0.963s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:28 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124" returned: 0 in 0.850s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:28 devstack sudo[98067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124
Jul 07 22:44:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:28 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:28 devstack sudo[98069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29
Jul 07 22:44:28 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:29 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6e2623a9-3e74-4307-a1be-0785491db124" returned: 0 in 0.751s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:29 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29" returned: 0 in 0.723s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-quobyte-6e2623a9-3e74-4307-a1be-0785491db124" released by "delete_volume" :: held 1.665s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b79439-9e41-46f4-a6bf-217a51df411e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd343503-df97-496a-a6b8-ed64b3fd2f29', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309b2897-cef5-447f-bda9-be85862f13ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:29 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Volume volume-cd343503-df97-496a-a6b8-ed64b3fd2f29 (cd343503-df97-496a-a6b8-ed64b3fd2f29): created successfully
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (309b2897-cef5-447f-bda9-be85862f13ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Flow 'volume_create_manager' (15ac4b56-a58b-4def-a762-e16dcfc68ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:29 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-dcf2f0cb-a54b-4a69-96f2-5421e8c188dc tempest-VolumesListAdminTestJSON-529771024 None] Created volume successfully.
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Created reservations ['2f975f7e-e8ce-4a55-943a-24f28f6f604a', '652b6260-c455-4871-9065-ca3ff5f4be62', '53d167ab-c869-4bb8-82bd-ad388e9c2651', 'fba08798-4a83-40fb-9583-4561193f4a73'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:29 devstack sudo[98073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:29 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "cinder-6f99869e-ffde-48bc-818b-2ba95109c2f9-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-6f99869e-ffde-48bc-818b-2ba95109c2f9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "cinder-quobyte-6f99869e-ffde-48bc-818b-2ba95109c2f9" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-quobyte-6f99869e-ffde-48bc-818b-2ba95109c2f9" acquired by "delete_volume" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f60b401-56f2-4064-9ef7-86a8c44486ef]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:29 devstack sudo[98075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9
Jul 07 22:44:29 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:30 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.892s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:30 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Deleted volume successfully.
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-54399d79-c828-46aa-936a-b16491e8300b tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-6e2623a9-3e74-4307-a1be-0785491db124-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Flow 'volume_create_manager' (03b8b258-eb99-43b1-9fca-b43e764c85ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6021b47-e538-426d-af95-6d064e987a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6021b47-e538-426d-af95-6d064e987a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8772f403-9182-4f3b-af1f-e5eb2ddc78aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c630e63fdcd1478ca788b8879b009c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:30Z,use_quota=True,user_id='2d99187db192498fbb13a466c402bfd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28155a30-3d05-4a1d-842d-70e6db042313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28155a30-3d05-4a1d-842d-70e6db042313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47871f24-3f74-4481-9ae5-44fb4d9b58cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47871f24-3f74-4481-9ae5-44fb4d9b58cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8772f403-9182-4f3b-af1f-e5eb2ddc78aa', 'volume_name': 'volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d97a3c1-e72b-44c1-8f65-55f5d49c8061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d97a3c1-e72b-44c1-8f65-55f5d49c8061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e417ee7c-8680-49d8-8afc-0f5875045da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:30 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Volume 8772f403-9182-4f3b-af1f-e5eb2ddc78aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa', 'volume_size': 1}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8772f403-9182-4f3b-af1f-e5eb2ddc78aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c630e63fdcd1478ca788b8879b009c36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:30Z,use_quota=True,user_id='2d99187db192498fbb13a466c402bfd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Creating volume 8772f403-9182-4f3b-af1f-e5eb2ddc78aa {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:30 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:30 devstack sudo[98099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa 1073741824
Jul 07 22:44:30 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:30 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9" returned: 0 in 1.030s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:30 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9
Jul 07 22:44:30 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:31 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa 1073741824" returned: 0 in 0.885s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:31 devstack sudo[98111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa
Jul 07 22:44:31 devstack sudo[98111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:31 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6f99869e-ffde-48bc-818b-2ba95109c2f9" returned: 0 in 0.705s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-quobyte-6f99869e-ffde-48bc-818b-2ba95109c2f9" released by "delete_volume" :: held 1.802s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Created reservations ['7a13e480-4413-4e57-bef2-1278a9661a78', '1eeb29bb-8798-4cd5-8d58-b01814015d1a', 'a674eb02-93b5-4096-afa3-fcafc16f2b44', 'f8404934-b346-4372-a144-4a1c57582cca'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:31 devstack sudo[98113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:31 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "cinder-b60e7b91-ebc6-45ca-822b-d874b0375b19-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-b60e7b91-ebc6-45ca-822b-d874b0375b19-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "cinder-quobyte-b60e7b91-ebc6-45ca-822b-d874b0375b19" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-quobyte-b60e7b91-ebc6-45ca-822b-d874b0375b19" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9df8f40-05bf-44d2-bb65-85c652b4575b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:32 devstack sudo[98115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19
Jul 07 22:44:32 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:32 devstack sudo[98111]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa" returned: 0 in 0.750s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e417ee7c-8680-49d8-8afc-0f5875045da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ccaecd-f3a9-4d96-916a-93475eba0059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:32 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Volume volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa (8772f403-9182-4f3b-af1f-e5eb2ddc78aa): created successfully
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73ccaecd-f3a9-4d96-916a-93475eba0059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Flow 'volume_create_manager' (03b8b258-eb99-43b1-9fca-b43e764c85ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6f175adc-a35b-426c-9a25-2e8b5e9a8ff6 tempest-VolumesListAdminTestJSON-1038653749 None] Created volume successfully.
Jul 07 22:44:32 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.697s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Deleted volume successfully.
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6c8abaea-2764-41be-83ef-ebdbe2f1ca2c tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-6f99869e-ffde-48bc-818b-2ba95109c2f9-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:32 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19" returned: 0 in 0.769s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:32 devstack sudo[98122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19
Jul 07 22:44:32 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:33 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b60e7b91-ebc6-45ca-822b-d874b0375b19" returned: 0 in 0.639s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-quobyte-b60e7b91-ebc6-45ca-822b-d874b0375b19" released by "delete_volume" :: held 1.456s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Created reservations ['e8f6b212-03bb-41f1-abae-9742c4c6400f', '1247fa8d-1734-49e8-a40c-d67bfcf06a5a', '24fa1ea3-55ad-41c2-be8f-b703ac40a7c7', '6b6ff012-38e1-46bb-9ef7-0cead74091a9'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Acquiring lock "cinder-8772f403-9182-4f3b-af1f-e5eb2ddc78aa-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:33 devstack sudo[98125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:33 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Lock "cinder-8772f403-9182-4f3b-af1f-e5eb2ddc78aa-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Acquiring lock "cinder-quobyte-8772f403-9182-4f3b-af1f-e5eb2ddc78aa" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Lock "cinder-quobyte-8772f403-9182-4f3b-af1f-e5eb2ddc78aa" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[463db8b8-8a40-4806-94d7-4e0565d45b5b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "cinder-cd343503-df97-496a-a6b8-ed64b3fd2f29-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-cd343503-df97-496a-a6b8-ed64b3fd2f29-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "cinder-quobyte-cd343503-df97-496a-a6b8-ed64b3fd2f29" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-quobyte-cd343503-df97-496a-a6b8-ed64b3fd2f29" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[df58f10e-3951-48da-a726-d1c8f97dab27]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:33 devstack sudo[98127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa
Jul 07 22:44:33 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:33 devstack sudo[98128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29
Jul 07 22:44:33 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:34 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.691s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:34 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:34 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Deleted volume successfully.
Jul 07 22:44:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-13eb8f97-c5ef-4dae-9c1a-b7d73f7b0eab tempest-CreateVolumesFromImageTest-1480545330 None] Lock "cinder-b60e7b91-ebc6-45ca-822b-d874b0375b19-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:34 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa" returned: 0 in 0.873s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:34 devstack sudo[98138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa
Jul 07 22:44:34 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:34 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29" returned: 0 in 0.847s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:34 devstack sudo[98140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29
Jul 07 22:44:34 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:35 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8772f403-9182-4f3b-af1f-e5eb2ddc78aa" returned: 0 in 0.740s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Lock "cinder-quobyte-8772f403-9182-4f3b-af1f-e5eb2ddc78aa" released by "delete_volume" :: held 1.664s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:35 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cd343503-df97-496a-a6b8-ed64b3fd2f29" returned: 0 in 0.727s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Created reservations ['8b586bf5-8efc-47f3-9f87-8351d4c5b6c1', '0c7395bc-9db4-449e-b56e-bd096443f30f', 'd1df4d1a-3967-4b34-951e-b8893d88650f', 'dac6e1a5-7140-4202-8608-7ce96f87cf6c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-quobyte-cd343503-df97-496a-a6b8-ed64b3fd2f29" released by "delete_volume" :: held 1.624s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:35 devstack sudo[98144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:35 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Created reservations ['6ffc780f-1716-47f6-bfbb-41c4d3ccc648', '10e12822-1b41-4c4f-a592-b39c477384a2', '961e0234-5d1b-4ae8-b55f-3731cf169e02', 'e4f262de-9387-42a0-9f2f-4cca9dbb8dfb'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:35 devstack sudo[98146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:35 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "cinder-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "cinder-quobyte-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-quobyte-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:36 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe2268-6ed5-41db-a190-26ccd6f3f6a1]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:36 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.812s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:36 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:36 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Deleted volume successfully.
Jul 07 22:44:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2f22da81-72a6-4931-8bb1-afafb940e19e tempest-VolumesListAdminTestJSON-1038653749 None] Lock "cinder-8772f403-9182-4f3b-af1f-e5eb2ddc78aa-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:36 devstack sudo[98149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2
Jul 07 22:44:36 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:36 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.830s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:36 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:36 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Deleted volume successfully.
Jul 07 22:44:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8b8cca1e-d6c1-4d4f-a1c0-9c18db158987 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-cd343503-df97-496a-a6b8-ed64b3fd2f29-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:37 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2" returned: 0 in 0.879s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:37 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2
Jul 07 22:44:37 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (196d4c38-fc90-44f4-b44a-954670cabdcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f4ac53-f991-4d9e-9c18-6a25abcde8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f4ac53-f991-4d9e-9c18-6a25abcde8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2103675676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63d727d-3349-484e-af99-3f444bc94ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:37Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfe7e48-5d50-4fb0-a493-9368eceb73ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dfe7e48-5d50-4fb0-a493-9368eceb73ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5acf7a6-74de-4c05-a33e-d4f1d79a1c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5acf7a6-74de-4c05-a33e-d4f1d79a1c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f63d727d-3349-484e-af99-3f444bc94ad4', 'volume_name': 'volume-f63d727d-3349-484e-af99-3f444bc94ad4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e780582-fa8c-4557-8009-0e08f7e579c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e780582-fa8c-4557-8009-0e08f7e579c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba773fa0-f080-4aa4-93dc-940c0419935d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:37 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume f63d727d-3349-484e-af99-3f444bc94ad4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f63d727d-3349-484e-af99-3f444bc94ad4', 'volume_size': 1}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2103675676',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f63d727d-3349-484e-af99-3f444bc94ad4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:37Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Creating volume f63d727d-3349-484e-af99-3f444bc94ad4 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:37 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:37 devstack sudo[98157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4 1073741824
Jul 07 22:44:37 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:37 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2" returned: 0 in 0.739s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-quobyte-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2" released by "delete_volume" :: held 1.696s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Created reservations ['2585525e-edff-4cc7-a33e-41acebd9abc1', '4aed9777-2443-4dc2-9b1d-50597991f9be', 'a47aaa6a-d1a1-4aac-b295-f68dce847f6e', 'f240f130-b12d-4d04-835a-8e85d47c2722'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:37 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:37 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "cinder-612892d7-6261-498d-95cf-ca6f6b13de72-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-612892d7-6261-498d-95cf-ca6f6b13de72-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "cinder-quobyte-612892d7-6261-498d-95cf-ca6f6b13de72" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-quobyte-612892d7-6261-498d-95cf-ca6f6b13de72" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbb6713-363d-4e9d-8cdb-d310b8bc2314]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:38 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4 1073741824" returned: 0 in 1.022s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:38 devstack sudo[98166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72
Jul 07 22:44:38 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:38 devstack sudo[98167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4
Jul 07 22:44:38 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:38 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.843s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:38 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Deleted volume successfully.
Jul 07 22:44:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0fa3efb7-3fbb-41f5-9637-a297a9e797a2 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-09ba66b9-4e2b-4c48-8d48-bad73cd5c6f2-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:39 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4" returned: 0 in 0.741s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:39 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba773fa0-f080-4aa4-93dc-940c0419935d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f63d727d-3349-484e-af99-3f444bc94ad4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e314374-2da1-4a8a-938c-b18d128e72db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72" returned: 0 in 0.862s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:39 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume volume-f63d727d-3349-484e-af99-3f444bc94ad4 (f63d727d-3349-484e-af99-3f444bc94ad4): created successfully
Jul 07 22:44:39 devstack sudo[98175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72
Jul 07 22:44:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e314374-2da1-4a8a-938c-b18d128e72db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:39 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:39 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (196d4c38-fc90-44f4-b44a-954670cabdcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:39 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5d1feb96-c69d-4f60-b7f1-d397af8f714f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created volume successfully.
Jul 07 22:44:39 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (c5852616-8f27-4d57-b282-ea0e7941b980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:40 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f367a2-6ef5-4b76-ae6b-b1eb104c4644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-612892d7-6261-498d-95cf-ca6f6b13de72" returned: 0 in 0.665s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-quobyte-612892d7-6261-498d-95cf-ca6f6b13de72" released by "delete_volume" :: held 1.574s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f367a2-6ef5-4b76-ae6b-b1eb104c4644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-144190799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89f99a0-aa15-4322-b4bc-97ec361f8f57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:40Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf0adf1-8f04-4c09-a039-4febb8d3fef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf0adf1-8f04-4c09-a039-4febb8d3fef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036a0c5d-ed66-4b10-badb-052c02ec5794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036a0c5d-ed66-4b10-badb-052c02ec5794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89f99a0-aa15-4322-b4bc-97ec361f8f57', 'volume_name': 'volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08914a52-fd3d-4af9-9c8e-3e3d1d4e96ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08914a52-fd3d-4af9-9c8e-3e3d1d4e96ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdeab3bd-48fc-4b3d-a3e8-e3689a0d9c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume f89f99a0-aa15-4322-b4bc-97ec361f8f57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57', 'volume_size': 1}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-144190799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89f99a0-aa15-4322-b4bc-97ec361f8f57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:40Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Creating volume f89f99a0-aa15-4322-b4bc-97ec361f8f57 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:40 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:40 devstack sudo[98178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57 1073741824
Jul 07 22:44:40 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Created reservations ['09b0f2c3-0eb4-47c4-beef-5761d641e50a', 'ceab82c3-5f1d-43f6-af48-d434dc5d7c7d', '0922a98f-8a26-4480-8278-faa7dd594137', 'c416a990-f9b9-4e84-8770-9c2c61cd187c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:40 devstack sudo[98180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:40 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (4852b876-7607-455c-9033-3ccdb8850b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c6d9c1-d06e-46a6-9865-1fa7b0cb22f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c6d9c1-d06e-46a6-9865-1fa7b0cb22f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1747791823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e195e9d7-8cfa-4e82-bc6a-7600d709248a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:40Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320c619f-18bf-47f1-a687-e9236b37ee3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320c619f-18bf-47f1-a687-e9236b37ee3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcd29d5-e1d2-4cd0-adf8-9ae311a64ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bcd29d5-e1d2-4cd0-adf8-9ae311a64ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e195e9d7-8cfa-4e82-bc6a-7600d709248a', 'volume_name': 'volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ef935b-a851-43ca-85a0-363b2b00b091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ef935b-a851-43ca-85a0-363b2b00b091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5310e05e-c96a-41bc-9820-5fd73edc206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume e195e9d7-8cfa-4e82-bc6a-7600d709248a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a', 'volume_size': 1}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (bf9d6404-7920-43ac-b8ee-e233988c3782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950aa4b9-00c0-4de1-9271-821a6d18c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (950aa4b9-00c0-4de1-9271-821a6d18c054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056758531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:41Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0139bd1-9444-42b2-829b-de1542aec425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0139bd1-9444-42b2-829b-de1542aec425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2a9e66-d9e5-487e-afd6-0dd70ad7fe99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc2a9e66-d9e5-487e-afd6-0dd70ad7fe99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce', 'volume_name': 'volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3918942e-ffa1-4746-a8b8-4af850dd3238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3918942e-ffa1-4746-a8b8-4af850dd3238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8660b45-a049-4d2f-b46c-c3dca94b4049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce', 'volume_size': 1}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.808s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:41 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Deleted volume successfully.
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d1e06e31-10a7-4018-9b5f-528eeac7ede4 tempest-VolumesListAdminTestJSON-529771024 None] Lock "cinder-612892d7-6261-498d-95cf-ca6f6b13de72-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:41 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (d4acaa1e-43e8-4a42-9234-750ecedba469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743d00c5-1507-4926-83f3-18ad3a23b899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57 1073741824" returned: 0 in 1.349s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (743d00c5-1507-4926-83f3-18ad3a23b899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-151456551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e310aca6-0da0-4f60-b544-4ba72afe39b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:41Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e162184-19c3-4cd4-8cd4-039683e19e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e162184-19c3-4cd4-8cd4-039683e19e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d684a21-e86b-4467-8554-215fc6f0e9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d684a21-e86b-4467-8554-215fc6f0e9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e310aca6-0da0-4f60-b544-4ba72afe39b0', 'volume_name': 'volume-e310aca6-0da0-4f60-b544-4ba72afe39b0', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662e2ec1-1aba-4bda-b3b1-e227aca0cedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (662e2ec1-1aba-4bda-b3b1-e227aca0cedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8e48f3-e9ee-4279-98a9-4483e50928dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume e310aca6-0da0-4f60-b544-4ba72afe39b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e310aca6-0da0-4f60-b544-4ba72afe39b0', 'volume_size': 1}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:41 devstack sudo[98189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57
Jul 07 22:44:41 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (484d7e27-11f7-4ee1-8de5-43335de5244b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff42d28-0bc9-4e63-8d2d-8fe0bde697f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff42d28-0bc9-4e63-8d2d-8fe0bde697f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301635895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e74a085-1822-4cf0-a0c1-ee19f403c387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:42Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11f61bf-6bcd-463a-985c-4670f4bda22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a11f61bf-6bcd-463a-985c-4670f4bda22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8848f84f-78e0-4e74-a912-27eb7b4fcc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8848f84f-78e0-4e74-a912-27eb7b4fcc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e74a085-1822-4cf0-a0c1-ee19f403c387', 'volume_name': 'volume-8e74a085-1822-4cf0-a0c1-ee19f403c387', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381be124-3d8a-4bcc-8428-19ee9fb2fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381be124-3d8a-4bcc-8428-19ee9fb2fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ac7b31-fc39-4e83-a794-4dac84689c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:41 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume 8e74a085-1822-4cf0-a0c1-ee19f403c387: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e74a085-1822-4cf0-a0c1-ee19f403c387', 'volume_size': 1}
Jul 07 22:44:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Flow 'volume_create_manager' (6228422d-c77c-4ef7-ace4-8c1a4ab62f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6b08c3-59be-4d35-8581-4777da119b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6b08c3-59be-4d35-8581-4777da119b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-376078199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229b19d1-8ea1-4322-a793-a238dda791d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b947282df924832ba4db4fb99371bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:42Z,use_quota=True,user_id='b26594037cd640b4945efbaab6fe8998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb767a39-8a47-46a1-b615-9a9432f78590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb767a39-8a47-46a1-b615-9a9432f78590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2c18d0-e88f-4988-b4a3-9c583e2732e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2c18d0-e88f-4988-b4a3-9c583e2732e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '229b19d1-8ea1-4322-a793-a238dda791d9', 'volume_name': 'volume-229b19d1-8ea1-4322-a793-a238dda791d9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:42 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885d3717-d111-4a66-b817-1330619a6411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885d3717-d111-4a66-b817-1330619a6411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c477a145-4be7-4845-8005-48bc437ccc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:42 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Volume 229b19d1-8ea1-4322-a793-a238dda791d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-229b19d1-8ea1-4322-a793-a238dda791d9', 'volume_size': 1}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57" returned: 0 in 0.919s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] <== create_volume: return (2373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.375s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.942s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1747791823',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e195e9d7-8cfa-4e82-bc6a-7600d709248a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:40Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Creating volume e195e9d7-8cfa-4e82-bc6a-7600d709248a {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:42 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdeab3bd-48fc-4b3d-a3e8-e3689a0d9c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:42 devstack sudo[98193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a 1073741824
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8b0e52-7538-47ff-90c3-e92ec0b523ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:42 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:42 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57 (f89f99a0-aa15-4322-b4bc-97ec361f8f57): created successfully
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f8b0e52-7538-47ff-90c3-e92ec0b523ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (c5852616-8f27-4d57-b282-ea0e7941b980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:42 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3a09cdad-eec6-4d2e-8e4b-16027adbbf23 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created volume successfully.
Jul 07 22:44:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:44:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:43 devstack sudo[98199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:43 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:43 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a 1073741824" returned: 0 in 1.113s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:43 devstack sudo[98207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a
Jul 07 22:44:43 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:44 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.752s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 28 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:44:44 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a" returned: 0 in 0.744s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.333s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1056758531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:41Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Creating volume ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:44 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5310e05e-c96a-41bc-9820-5fd73edc206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a269d7-c01f-410d-8a04-ce94af2a92fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:44 devstack sudo[98211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce 1073741824
Jul 07 22:44:44 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:44 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a (e195e9d7-8cfa-4e82-bc6a-7600d709248a): created successfully
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a269d7-c01f-410d-8a04-ce94af2a92fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (4852b876-7607-455c-9033-3ccdb8850b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:44 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c97bd91a-1836-4a3b-9ff2-4601f95b62a5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created volume successfully.
Jul 07 22:44:45 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce 1073741824" returned: 0 in 0.961s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:45 devstack sudo[98217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce
Jul 07 22:44:45 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:46 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce" returned: 0 in 0.700s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.601s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-151456551',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e310aca6-0da0-4f60-b544-4ba72afe39b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:41Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Creating volume e310aca6-0da0-4f60-b544-4ba72afe39b0 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:46 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:46 devstack sudo[98220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0 1073741824
Jul 07 22:44:46 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8660b45-a049-4d2f-b46c-c3dca94b4049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418f7d27-ab32-497f-93e7-f05f753fb306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:46 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce (ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce): created successfully
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (418f7d27-ab32-497f-93e7-f05f753fb306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (bf9d6404-7920-43ac-b8ee-e233988c3782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Flow 'volume_create_manager' (c26e2629-9351-4b83-95e2-749b4ed3c45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2524b2df-21e9-48f4-84a3-cc9af9fc4c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:46 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a8cdedca-404a-405c-8686-c914044c1d4c tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created volume successfully.
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2524b2df-21e9-48f4-84a3-cc9af9fc4c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-901728933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93d7d56-3d18-44cf-a067-6927270269a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f63bc805e594b62969605d7ec795809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:46Z,use_quota=True,user_id='6e0a662f9d1a405a9458718cc8dc3f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665710c8-ed4a-47c6-928d-8293b4453e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665710c8-ed4a-47c6-928d-8293b4453e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8e76db-3910-4638-a033-5fb4437adb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.image.glance [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Creating Keystone auth plugin from conf {{(pid=88077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8e76db-3910-4638-a033-5fb4437adb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b93d7d56-3d18-44cf-a067-6927270269a0', 'volume_name': 'volume-b93d7d56-3d18-44cf-a067-6927270269a0', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72c2e6c0>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f117be-6c1d-4e58-9ebc-9452a01e7709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f117be-6c1d-4e58-9ebc-9452a01e7709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfe0ab7-5f0b-480b-83ae-bc1d17e5e553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:46 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Volume b93d7d56-3d18-44cf-a067-6927270269a0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b93d7d56-3d18-44cf-a067-6927270269a0', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72c2e6c0>}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Trying to clone b93d7d56-3d18-44cf-a067-6927270269a0 from image 92445205-e8e3-4b89-b69d-7e05b2a64f9f at location (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]). {{(pid=88077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:44:46 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a25041-4375-4786-a5c0-70188d979747]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:47 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0 1073741824" returned: 0 in 0.914s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:47 devstack sudo[98227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD
Jul 07 22:44:47 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:INSERT=37,cinder:UPDATE=150,cinder:SELECT=102,cinder:DELETE=19 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:47 devstack sudo[98229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0
Jul 07 22:44:47 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:47 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Temporary image 92445205-e8e3-4b89-b69d-7e05b2a64f9f is fetched for user 6e0a662f9d1a405a9458718cc8dc3f6d. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ba2f89-af0f-4c34-9e7b-facedd8a8c66]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:47 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0" returned: 0 in 0.694s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.844s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1301635895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e74a085-1822-4cf0-a0c1-ee19f403c387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53ac23eaa38a442f81c1ff195fe444ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:42Z,use_quota=True,user_id='cbd9cfe0680d4f0d86619f8ede70eb7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Creating volume 8e74a085-1822-4cf0-a0c1-ee19f403c387 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:47 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:47 devstack sudo[98236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387 1073741824
Jul 07 22:44:47 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8e48f3-e9ee-4279-98a9-4483e50928dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e310aca6-0da0-4f60-b544-4ba72afe39b0', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c25197-0e79-47ff-b234-a48994808926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:47 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume volume-e310aca6-0da0-4f60-b544-4ba72afe39b0 (e310aca6-0da0-4f60-b544-4ba72afe39b0): created successfully
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c25197-0e79-47ff-b234-a48994808926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (d4acaa1e-43e8-4a42-9234-750ecedba469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:47 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD
Jul 07 22:44:47 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-aa965cf4-2c61-4da9-9688-f87cf71aa1ba tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created volume successfully.
Jul 07 22:44:48 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD" returned: 0 in 0.783s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:48 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387 1073741824" returned: 0 in 0.887s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:48 devstack sudo[98246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387
Jul 07 22:44:48 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:49 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387" returned: 0 in 0.677s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.942s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-376078199',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=229b19d1-8ea1-4322-a793-a238dda791d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b947282df924832ba4db4fb99371bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:42Z,use_quota=True,user_id='b26594037cd640b4945efbaab6fe8998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Creating volume 229b19d1-8ea1-4322-a793-a238dda791d9 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:49 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ac7b31-fc39-4e83-a794-4dac84689c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e74a085-1822-4cf0-a0c1-ee19f403c387', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2b8c39-2cc7-4312-b953-63d5fc75dc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:49 devstack sudo[98249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9 1073741824
Jul 07 22:44:49 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:49 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Volume volume-8e74a085-1822-4cf0-a0c1-ee19f403c387 (8e74a085-1822-4cf0-a0c1-ee19f403c387): created successfully
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a2b8c39-2cc7-4312-b953-63d5fc75dc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Flow 'volume_create_manager' (484d7e27-11f7-4ee1-8de5-43335de5244b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:49 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ba2cfa91-8571-4b36-b2eb-da68a9192df5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created volume successfully.
Jul 07 22:44:50 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9 1073741824" returned: 0 in 0.814s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=155,cinder:SELECT=105,cinder:INSERT=41,cinder:DELETE=11 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:50 devstack sudo[98255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9
Jul 07 22:44:50 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-8e74a085-1822-4cf0-a0c1-ee19f403c387-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-8e74a085-1822-4cf0-a0c1-ee19f403c387-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-quobyte-8e74a085-1822-4cf0-a0c1-ee19f403c387" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-8e74a085-1822-4cf0-a0c1-ee19f403c387" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6c8906-028d-4121-8821-b3a1152abae3]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:50 devstack sudo[98258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387
Jul 07 22:44:50 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:50 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9" returned: 0 in 0.673s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.410s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-901728933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93d7d56-3d18-44cf-a067-6927270269a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f63bc805e594b62969605d7ec795809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:46Z,use_quota=True,user_id='6e0a662f9d1a405a9458718cc8dc3f6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Creating volume b93d7d56-3d18-44cf-a067-6927270269a0 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:50 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:44:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:50 devstack sudo[98261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 1073741824
Jul 07 22:44:50 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c477a145-4be7-4845-8005-48bc437ccc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-229b19d1-8ea1-4322-a793-a238dda791d9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9634ab0-ce50-420b-a79f-016a527cf050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:51 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Volume volume-229b19d1-8ea1-4322-a793-a238dda791d9 (229b19d1-8ea1-4322-a793-a238dda791d9): created successfully
Jul 07 22:44:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9634ab0-ce50-420b-a79f-016a527cf050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Flow 'volume_create_manager' (6228422d-c77c-4ef7-ace4-8c1a4ab62f45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:51 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a13ed407-9425-47f3-88b5-aaefcd0ca392 tempest-AttachVolumeNegativeTest-1880869948 None] Created volume successfully.
Jul 07 22:44:51 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387" returned: 0 in 0.827s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:51 devstack sudo[98266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387
Jul 07 22:44:51 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:51 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 1073741824" returned: 0 in 0.933s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:51 devstack sudo[98271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0
Jul 07 22:44:51 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:52 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8e74a085-1822-4cf0-a0c1-ee19f403c387" returned: 0 in 0.679s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-8e74a085-1822-4cf0-a0c1-ee19f403c387" released by "delete_volume" :: held 1.558s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created reservations ['b31c69ef-1456-49ce-b879-14a08814143e', 'c27e85ca-762a-4ea8-9c8e-de1650a4bc81', 'f3d298ab-d6cc-4593-aff2-19d9ba95cf4f', 'dde3f9b5-adb9-4d47-865e-96c327e1044f'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:52 devstack sudo[98277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:52 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:52 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0" returned: 0 in 0.707s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Attempting download of 92445205-e8e3-4b89-b69d-7e05b2a64f9f ((None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}])) to volume b93d7d56-3d18-44cf-a067-6927270269a0. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd88c92-53e4-4c80-8e94-3f7d36b008fa]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_8cby6rm3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-e310aca6-0da0-4f60-b544-4ba72afe39b0-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:52 devstack sudo[98280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_8cby6rm3
Jul 07 22:44:52 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-e310aca6-0da0-4f60-b544-4ba72afe39b0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-quobyte-e310aca6-0da0-4f60-b544-4ba72afe39b0" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-e310aca6-0da0-4f60-b544-4ba72afe39b0" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd74c296-d16c-4781-a921-1b0cb33303a5]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:53 devstack sudo[98282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0
Jul 07 22:44:53 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:53 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.772s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:53 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:53 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Deleted volume successfully.
Jul 07 22:44:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e98ae1b3-18f1-43df-b43d-fbdce2a52d66 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-8e74a085-1822-4cf0-a0c1-ee19f403c387-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:53 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_8cby6rm3" returned: 0 in 0.823s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_8cby6rm3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:53 devstack sudo[98287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_8cby6rm3
Jul 07 22:44:53 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:53 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0" returned: 0 in 0.817s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:53 devstack sudo[98292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0
Jul 07 22:44:53 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:54 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_8cby6rm3" returned: 1 in 0.736s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_8cby6rm3' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fd7f4c-4fb0-4af7-801f-814cd801e425]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:54 devstack sudo[98296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD
Jul 07 22:44:54 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:54 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e310aca6-0da0-4f60-b544-4ba72afe39b0" returned: 0 in 0.810s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-e310aca6-0da0-4f60-b544-4ba72afe39b0" released by "delete_volume" :: held 1.670s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created reservations ['f4a201f3-3742-41af-a6e1-dbe5ac34d651', '68bf182b-0930-48a5-b29e-43f5a38ac85e', '632a4832-2ae7-4307-a9e0-b6db3f04c017', 'd4f932c4-abdc-412d-9708-a3fc1bbe6b25'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:54 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:54 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:55 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD" returned: 0 in 0.844s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] 92445205-e8e3-4b89-b69d-7e05b2a64f9f was qcow2, converting to raw {{(pid=88077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:55 devstack sudo[98304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0
Jul 07 22:44:55 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-quobyte-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce" acquired by "delete_volume" :: waited 0.041s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[de19a879-286d-425e-b942-6b6d391e7c57]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-5eedad39-a513-4102-b27d-62504656ff63 req-463fd571-f7c5-4172-949e-45e98011638d tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-5eedad39-a513-4102-b27d-62504656ff63 req-463fd571-f7c5-4172-949e-45e98011638d tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1792ab0e-31bf-4cf0-9368-e161a92a3e42]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-5eedad39-a513-4102-b27d-62504656ff63 req-463fd571-f7c5-4172-949e-45e98011638d tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:55 devstack sudo[98314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce
Jul 07 22:44:55 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:55 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.771s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Deleted volume successfully.
Jul 07 22:44:55 devstack sudo[98316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9
Jul 07 22:44:55 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-125b217f-3a36-41c3-bfac-695af206d404 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-e310aca6-0da0-4f60-b544-4ba72afe39b0-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:56 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-5eedad39-a513-4102-b27d-62504656ff63 req-463fd571-f7c5-4172-949e-45e98011638d tempest-AttachVolumeNegativeTest-1880869948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9" returned: 0 in 0.893s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-5eedad39-a513-4102-b27d-62504656ff63 req-463fd571-f7c5-4172-949e-45e98011638d tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.915s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:56 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce" returned: 0 in 1.032s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-5eedad39-a513-4102-b27d-62504656ff63 req-463fd571-f7c5-4172-949e-45e98011638d tempest-AttachVolumeNegativeTest-1880869948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-229b19d1-8ea1-4322-a793-a238dda791d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6c7fcba9-4eb0-4dd4-acfe-1a31609b94b7', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:44:56 devstack sudo[98332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce
Jul 07 22:44:56 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-5eedad39-a513-4102-b27d-62504656ff63 req-463fd571-f7c5-4172-949e-45e98011638d tempest-AttachVolumeNegativeTest-1880869948 None] attachment_update completed successfully.
Jul 07 22:44:57 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce" returned: 0 in 0.778s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce" released by "delete_volume" :: held 1.896s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created reservations ['62d26d96-720d-43ee-ae69-203a3399781d', '35ef5c16-380b-4614-ac34-1d38045fd4aa', 'e5ceb825-d617-4a17-8b0c-6c7ef7ea9525', 'f77710ba-c20f-40bd-bfea-cd7584b8ca3d'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:57 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0" returned: 0 in 2.200s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_1vt8kairdevstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:44:57 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Converted 112.00 MB image at 50.88 MB/s
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:57 devstack sudo[98402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 1G
Jul 07 22:44:57 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:57 devstack sudo[98404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:57 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-e195e9d7-8cfa-4e82-bc6a-7600d709248a-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-e195e9d7-8cfa-4e82-bc6a-7600d709248a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-quobyte-e195e9d7-8cfa-4e82-bc6a-7600d709248a" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-e195e9d7-8cfa-4e82-bc6a-7600d709248a" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f343d46a-9486-45f7-ae44-8181108abd3d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:57 devstack sudo[98406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a
Jul 07 22:44:57 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:58 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.832s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:58 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:58 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Deleted volume successfully.
Jul 07 22:44:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-724bce5d-394a-43a1-b88d-31d22992e6b5 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-ce997c70-7f9c-4f1c-93b5-3b99d23fe0ce-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:58 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 1G" returned: 0 in 0.922s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:58 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4d4b31-0d69-44b5-829a-b5e73cda2761]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:58 devstack sudo[98728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0
Jul 07 22:44:58 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:58 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a" returned: 0 in 0.904s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:58 devstack sudo[98733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a
Jul 07 22:44:58 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:59 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0" returned: 0 in 0.852s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:59 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e195e9d7-8cfa-4e82-bc6a-7600d709248a" returned: 0 in 0.692s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-e195e9d7-8cfa-4e82-bc6a-7600d709248a" released by "delete_volume" :: held 1.648s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:59 devstack sudo[98738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0
Jul 07 22:44:59 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created reservations ['29e89078-3892-4456-8922-7f006940833a', '63461c19-a6b0-4cf2-8ee9-c4ff7e68ed90', '4dea6796-ff12-4530-8a07-38cdba1e919e', '7f780b1b-ce55-4f6f-ae8d-196f2d0a30d1'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:59 devstack sudo[98740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:44:59 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-f89f99a0-aa15-4322-b4bc-97ec361f8f57-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-f89f99a0-aa15-4322-b4bc-97ec361f8f57-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-quobyte-f89f99a0-aa15-4322-b4bc-97ec361f8f57" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-f89f99a0-aa15-4322-b4bc-97ec361f8f57" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0eb036b-feeb-40d1-bb25-6d716500b944]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:00 devstack sudo[98742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57
Jul 07 22:45:00 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:00 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.690s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:00 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0" returned: 1 in 0.907s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Downloaded image 92445205-e8e3-4b89-b69d-7e05b2a64f9f ((None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}])) to volume b93d7d56-3d18-44cf-a067-6927270269a0 successfully. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Temporary image 92445205-e8e3-4b89-b69d-7e05b2a64f9f for user 6e0a662f9d1a405a9458718cc8dc3f6d is deleted. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Marking volume b93d7d56-3d18-44cf-a067-6927270269a0 as bootable. {{(pid=88077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:45:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Deleted volume successfully.
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Copying metadata from image 92445205-e8e3-4b89-b69d-7e05b2a64f9f to b93d7d56-3d18-44cf-a067-6927270269a0. {{(pid=88077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Creating volume glance metadata for volume b93d7d56-3d18-44cf-a067-6927270269a0 backed by image 92445205-e8e3-4b89-b69d-7e05b2a64f9f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-354f638f-03dc-4fdd-a661-17646a342eeb tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-e195e9d7-8cfa-4e82-bc6a-7600d709248a-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cfe0ab7-5f0b-480b-83ae-bc1d17e5e553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93d7d56-3d18-44cf-a067-6927270269a0', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72c2e6c0>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385bef88-cb09-42ca-8df6-6e0175a3860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:00 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Volume volume-b93d7d56-3d18-44cf-a067-6927270269a0 (b93d7d56-3d18-44cf-a067-6927270269a0): created successfully
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385bef88-cb09-42ca-8df6-6e0175a3860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Flow 'volume_create_manager' (c26e2629-9351-4b83-95e2-749b4ed3c45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-dff8c347-a763-4112-b279-e36c4bb4d89a tempest-VolumesImageMetadata-1054658994 None] Created volume successfully.
Jul 07 22:45:00 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57" returned: 0 in 0.848s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:00 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57
Jul 07 22:45:00 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:01 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f89f99a0-aa15-4322-b4bc-97ec361f8f57" returned: 0 in 0.726s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-f89f99a0-aa15-4322-b4bc-97ec361f8f57" released by "delete_volume" :: held 1.616s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created reservations ['40e88e42-5743-4afa-ae2c-929460769ce1', 'db124fd8-799d-4186-a1ad-212bfee71048', '96c8f007-a2b1-47ef-94b2-d58a0dce3c24', '5f43c9a5-4c34-415a-ae0d-fd8c85140bbb'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Acquiring lock "cinder-b93d7d56-3d18-44cf-a067-6927270269a0-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Lock "cinder-b93d7d56-3d18-44cf-a067-6927270269a0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:01 devstack sudo[98755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:45:01 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Acquiring lock "cinder-quobyte-b93d7d56-3d18-44cf-a067-6927270269a0" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Lock "cinder-quobyte-b93d7d56-3d18-44cf-a067-6927270269a0" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d5d0ef-b36a-45f8-8422-361964ce3738]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:01 devstack sudo[98757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0
Jul 07 22:45:01 devstack sudo[98757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-f63d727d-3349-484e-af99-3f444bc94ad4-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-f63d727d-3349-484e-af99-3f444bc94ad4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "cinder-quobyte-f63d727d-3349-484e-af99-3f444bc94ad4" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-f63d727d-3349-484e-af99-3f444bc94ad4" acquired by "delete_volume" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff47785-5d4c-4441-8b0c-e483956bc1bf]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:02 devstack sudo[98762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4
Jul 07 22:45:02 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:02 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.845s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Deleted volume successfully.
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a985c301-fe85-43da-a787-a24ec4ffcb8f tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-f89f99a0-aa15-4322-b4bc-97ec361f8f57-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:02 devstack sudo[98757]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0" returned: 0 in 1.039s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:02 devstack sudo[98767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0
Jul 07 22:45:02 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:03 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4" returned: 0 in 0.936s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:03 devstack sudo[98772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4
Jul 07 22:45:03 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:03 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0" returned: 1 in 0.835s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:45:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:03 devstack sudo[98777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0
Jul 07 22:45:03 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:03 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f63d727d-3349-484e-af99-3f444bc94ad4" returned: 0 in 0.761s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:03 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-quobyte-f63d727d-3349-484e-af99-3f444bc94ad4" released by "delete_volume" :: held 1.759s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Created reservations ['143fbce8-42f7-43d7-afff-150a7fd54ab4', '0fd4f066-5815-4bf4-b87f-d58436289a6d', '3ddd9547-be15-4719-b0cd-9fb0565908a8', 'd63d83fe-8290-4c16-af36-e8ed93a27033'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:04 devstack sudo[98780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:45:04 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:04 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b93d7d56-3d18-44cf-a067-6927270269a0" returned: 0 in 0.824s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Lock "cinder-quobyte-b93d7d56-3d18-44cf-a067-6927270269a0" released by "delete_volume" :: held 2.798s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Created reservations ['84ce09b7-b155-4770-bff2-c225791027ee', '5c40b4a6-7e1a-493f-95dc-b626c38d3170', '9d98ec90-12c3-47bf-90bd-424c28f08f68', 'ee2db07d-9d3b-4a53-ba14-d5e6890a4932'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:04 devstack sudo[98783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:45:04 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:04 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.806s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Deleted volume successfully.
Jul 07 22:45:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-468796b6-2786-4008-9b46-ee610520ca26 tempest-CreateVolumesFromSourceVolumeTest-1071582069 None] Lock "cinder-f63d727d-3349-484e-af99-3f444bc94ad4-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:05 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.000s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:05 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:05 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Deleted volume successfully.
Jul 07 22:45:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a6a518c6-5a86-4066-b104-7382291d606d tempest-VolumesImageMetadata-1054658994 None] Lock "cinder-b93d7d56-3d18-44cf-a067-6927270269a0-delete_volume" released by "delete_volume" :: held 4.115s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Flow 'volume_create_manager' (a35e9a6b-e872-4491-a8f4-ae3e6391f7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24700b26-dc6f-4748-a5fc-ca47754abe04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24700b26-dc6f-4748-a5fc-ca47754abe04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc0fca0-a126-4e40-86e3-389e559ffb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977c17f3c2304350beabe9b733ad06f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:08Z,use_quota=True,user_id='812e82bcfb814b8687ca011d4814b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f15671-d306-4242-b370-432ede8258ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f15671-d306-4242-b370-432ede8258ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1376c8be-d368-43b1-8253-d980febc91f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1376c8be-d368-43b1-8253-d980febc91f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc0fca0-a126-4e40-86e3-389e559ffb14', 'volume_name': 'volume-6bc0fca0-a126-4e40-86e3-389e559ffb14', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c869aa6-97fa-4492-a0ed-deb242bb59a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c869aa6-97fa-4492-a0ed-deb242bb59a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9639629e-7f47-4599-8d71-1c449a6a6540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:08 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Volume 6bc0fca0-a126-4e40-86e3-389e559ffb14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc0fca0-a126-4e40-86e3-389e559ffb14', 'volume_size': 1}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bc0fca0-a126-4e40-86e3-389e559ffb14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977c17f3c2304350beabe9b733ad06f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:08Z,use_quota=True,user_id='812e82bcfb814b8687ca011d4814b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Creating volume 6bc0fca0-a126-4e40-86e3-389e559ffb14 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:08 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:08 devstack sudo[98801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14 1073741824
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:08 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Flow 'volume_create_manager' (c8b8781c-448d-4e6f-a040-1b22d9920cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8e9c81-546a-4c35-9d0c-ed5e22d82a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8e9c81-546a-4c35-9d0c-ed5e22d82a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-369088064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab0f277-644e-4d11-aeb4-d5dac44d29f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1dd20b1ca54d75916e5a8e573b33ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:08Z,use_quota=True,user_id='a062c0fa978345179a3db42129b7cd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c172a92-8f20-40e4-bfa5-a55b3111e0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c172a92-8f20-40e4-bfa5-a55b3111e0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062c2879-0aad-4d61-8a04-ece7843d1f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062c2879-0aad-4d61-8a04-ece7843d1f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ab0f277-644e-4d11-aeb4-d5dac44d29f4', 'volume_name': 'volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d873ebd1-dc79-4533-ba98-8fcc24adf551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d873ebd1-dc79-4533-ba98-8fcc24adf551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6fb0e6-15e2-471a-917b-e7df9c5fd719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:08 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Volume 1ab0f277-644e-4d11-aeb4-d5dac44d29f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4', 'volume_size': 1}
Jul 07 22:45:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:09 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14 1073741824" returned: 0 in 0.909s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:09 devstack sudo[98806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14
Jul 07 22:45:09 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:10 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14" returned: 0 in 0.686s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.517s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-369088064',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab0f277-644e-4d11-aeb4-d5dac44d29f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c1dd20b1ca54d75916e5a8e573b33ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:08Z,use_quota=True,user_id='a062c0fa978345179a3db42129b7cd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Creating volume 1ab0f277-644e-4d11-aeb4-d5dac44d29f4 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:10 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9639629e-7f47-4599-8d71-1c449a6a6540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc0fca0-a126-4e40-86e3-389e559ffb14', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:10 devstack sudo[98809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 1073741824
Jul 07 22:45:10 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269e7bd6-b322-47fb-b3ce-020013f14ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:10 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Volume volume-6bc0fca0-a126-4e40-86e3-389e559ffb14 (6bc0fca0-a126-4e40-86e3-389e559ffb14): created successfully
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269e7bd6-b322-47fb-b3ce-020013f14ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Flow 'volume_create_manager' (a35e9a6b-e872-4491-a8f4-ae3e6391f7ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:10 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a2a0abbf-11a5-4b1a-9cf1-f17e600ead71 tempest-CinderUnicodeTest-1650782977 None] Created volume successfully.
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Flow 'volume_create_manager' (76795254-fbb5-4d19-bb0f-7763790f6966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f481d01d-5595-47e7-9f24-c8b0d7c8336a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f481d01d-5595-47e7-9f24-c8b0d7c8336a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-416188448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e40863-425a-4253-9a10-603670b7c764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977c17f3c2304350beabe9b733ad06f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:11Z,use_quota=True,user_id='812e82bcfb814b8687ca011d4814b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f083754c-24ea-4e7a-ac88-8ce1ce71d38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f083754c-24ea-4e7a-ac88-8ce1ce71d38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0aa33fa-9295-4112-a88c-faadd36cd196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0aa33fa-9295-4112-a88c-faadd36cd196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e40863-425a-4253-9a10-603670b7c764', 'volume_name': 'volume-e7e40863-425a-4253-9a10-603670b7c764', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38535309-d41a-4b5c-9b2c-731f68cfede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38535309-d41a-4b5c-9b2c-731f68cfede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7003d8a4-1f98-4d90-9d6e-bf7aaad4a7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:11 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Volume e7e40863-425a-4253-9a10-603670b7c764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e40863-425a-4253-9a10-603670b7c764', 'volume_size': 1}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:11 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 1073741824" returned: 0 in 1.121s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:11 devstack sudo[98816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4
Jul 07 22:45:11 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:12 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" returned: 0 in 0.856s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-416188448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e40863-425a-4253-9a10-603670b7c764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977c17f3c2304350beabe9b733ad06f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:11Z,use_quota=True,user_id='812e82bcfb814b8687ca011d4814b885',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Creating volume e7e40863-425a-4253-9a10-603670b7c764 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:12 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6fb0e6-15e2-471a-917b-e7df9c5fd719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8aa9a1-795e-4422-a596-515b34c13504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:12 devstack sudo[98819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764 1073741824
Jul 07 22:45:12 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:12 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Volume volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 (1ab0f277-644e-4d11-aeb4-d5dac44d29f4): created successfully
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a8aa9a1-795e-4422-a596-515b34c13504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Flow 'volume_create_manager' (c8b8781c-448d-4e6f-a040-1b22d9920cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:12 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-15f416ab-eeb8-448d-b2f4-bed1aa22517e tempest-SnapshotMetadataTestJSON-1549091916 None] Created volume successfully.
Jul 07 22:45:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:13 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764 1073741824" returned: 0 in 1.185s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:13 devstack sudo[98844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764
Jul 07 22:45:13 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:14 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764" returned: 0 in 0.677s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.125s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Creating offline snapshot 4e15b883-c7de-4487-b774-ac7c8a27236b of volume 1ab0f277-644e-4d11-aeb4-d5dac44d29f4 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7003d8a4-1f98-4d90-9d6e-bf7aaad4a7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e40863-425a-4253-9a10-603670b7c764', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73166457-2d2a-4ec5-a078-255d94137c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e4248-30bc-417e-a765-b1dada95a5a5]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:14 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Volume volume-e7e40863-425a-4253-9a10-603670b7c764 (e7e40863-425a-4253-9a10-603670b7c764): created successfully
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73166457-2d2a-4ec5-a078-255d94137c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Flow 'volume_create_manager' (76795254-fbb5-4d19-bb0f-7763790f6966) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:14 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-28854833-5a15-4f20-8921-8611973d8646 tempest-CinderUnicodeTest-1650782977 None] Created volume successfully.
Jul 07 22:45:14 devstack sudo[98847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4
Jul 07 22:45:14 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:14 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" returned: 0 in 0.776s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:14 devstack sudo[98852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b 1G
Jul 07 22:45:14 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:15 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b 1G" returned: 0 in 0.896s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:15 devstack sudo[98861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b
Jul 07 22:45:15 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:16 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b" returned: 0 in 0.775s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:16 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b is being set with open permissions: ugo+rw
Jul 07 22:45:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:16 devstack sudo[98880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b
Jul 07 22:45:16 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:17 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b" returned: 0 in 0.792s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:17 devstack sudo[98950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.info
Jul 07 22:45:17 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:18 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.info" returned: 0 in 0.677s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:18 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.info is being set with open permissions: ugo+rw
Jul 07 22:45:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:18 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.info
Jul 07 22:45:18 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:18 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.info" returned: 0 in 0.756s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.794s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.278s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Creating offline snapshot c9c970ec-364a-4bcb-89fa-ca65051c62b4 of volume e7e40863-425a-4253-9a10-603670b7c764 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:45:18 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5fc3fd-d65d-4270-9d1d-2282561b1958]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:18 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-222f60ef-b37f-452e-8ed7-f999493970c1 tempest-SnapshotMetadataTestJSON-1549091916 None] Create snapshot completed successfully
Jul 07 22:45:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:19 devstack sudo[98976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764
Jul 07 22:45:19 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:19 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764" returned: 0 in 0.998s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:19 devstack sudo[98983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4 1G
Jul 07 22:45:19 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Acquiring lock "cinder-4e15b883-c7de-4487-b774-ac7c8a27236b-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "cinder-4e15b883-c7de-4487-b774-ac7c8a27236b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Acquiring lock "cinder-quobyte-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "cinder-quobyte-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Acquiring lock "cinder-quobyte-4e15b883-c7de-4487-b774-ac7c8a27236b" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "cinder-quobyte-4e15b883-c7de-4487-b774-ac7c8a27236b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Deleting offline snapshot 4e15b883-c7de-4487-b774-ac7c8a27236b of volume 1ab0f277-644e-4d11-aeb4-d5dac44d29f4 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:45:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] snapshot_file for this snap is: volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:45:20 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbc0e9b-fe3c-4084-8345-03f6cdfeecdd]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:20 devstack sudo[98985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b
Jul 07 22:45:20 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:21 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4 1G" returned: 0 in 1.237s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7e40863-425a-4253-9a10-603670b7c764 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:21 devstack sudo[98995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7e40863-425a-4253-9a10-603670b7c764 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4
Jul 07 22:45:21 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:21 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b" returned: 0 in 1.067s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:45:21 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2f3458-15c1-4514-98b7-548bb54a84c3]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:21 devstack sudo[98997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4
Jul 07 22:45:21 devstack sudo[98997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:22 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7e40863-425a-4253-9a10-603670b7c764 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4" returned: 0 in 0.887s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:22 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4 is being set with open permissions: ugo+rw
Jul 07 22:45:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:22 devstack sudo[99003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4
Jul 07 22:45:22 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:22 devstack sudo[98997]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" returned: 0 in 1.294s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:22 devstack sudo[99010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b
Jul 07 22:45:22 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:22 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4" returned: 0 in 0.886s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:23 devstack sudo[99013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.info
Jul 07 22:45:23 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:23 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b" returned: 0 in 0.853s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:23 devstack sudo[99019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b
Jul 07 22:45:23 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:23 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.info" returned: 0 in 0.788s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:23 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.info is being set with open permissions: ugo+rw
Jul 07 22:45:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:23 devstack sudo[99022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.info
Jul 07 22:45:23 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:24 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4.4e15b883-c7de-4487-b774-ac7c8a27236b" returned: 0 in 0.798s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "cinder-quobyte-4e15b883-c7de-4487-b774-ac7c8a27236b" released by "_delete_snapshot" :: held 4.203s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "cinder-quobyte-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" released by "delete_snapshot" :: held 4.247s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:24 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.info" returned: 0 in 0.689s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.620s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:24 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-83387538-38c2-4332-8be0-bc4db1aa8c9e tempest-CinderUnicodeTest-1650782977 None] Create snapshot completed successfully
Jul 07 22:45:24 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Created reservations ['76f9d227-7f49-495e-86bc-ebbca96bc114', '65a00562-0bfa-4917-8571-9961cb05e78e', 'b88ef312-8e7d-4cc4-920a-597c1a915135', '797368bb-5080-4d66-bc5e-dc6fb8fb5e82'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:24 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Delete snapshot completed successfully.
Jul 07 22:45:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5072f24-ca7e-443a-8e09-075d6741c6e1 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "cinder-4e15b883-c7de-4487-b774-ac7c8a27236b-delete_snapshot" released by "delete_snapshot" :: held 4.459s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "cinder-c9c970ec-364a-4bcb-89fa-ca65051c62b4-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-c9c970ec-364a-4bcb-89fa-ca65051c62b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "cinder-quobyte-e7e40863-425a-4253-9a10-603670b7c764" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-quobyte-e7e40863-425a-4253-9a10-603670b7c764" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "cinder-quobyte-c9c970ec-364a-4bcb-89fa-ca65051c62b4" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-quobyte-c9c970ec-364a-4bcb-89fa-ca65051c62b4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Deleting offline snapshot c9c970ec-364a-4bcb-89fa-ca65051c62b4 of volume e7e40863-425a-4253-9a10-603670b7c764 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] snapshot_file for this snap is: volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9ab0a6-c392-4bc8-b8a0-f88603d524d5]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:25 devstack sudo[99026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4
Jul 07 22:45:25 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Acquiring lock "cinder-1ab0f277-644e-4d11-aeb4-d5dac44d29f4-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "cinder-1ab0f277-644e-4d11-aeb4-d5dac44d29f4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Acquiring lock "cinder-quobyte-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "cinder-quobyte-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9405c5cd-3f75-43b8-b0e0-adc131848eb0]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:25 devstack sudo[99028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4
Jul 07 22:45:25 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:26 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4" returned: 0 in 0.904s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7e40863-425a-4253-9a10-603670b7c764(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:45:26 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f579e1-c00c-4353-8371-6708039ad7c8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:26 devstack sudo[99033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764
Jul 07 22:45:26 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:26 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" returned: 0 in 0.828s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:26 devstack sudo[99038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4
Jul 07 22:45:26 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:26 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764" returned: 0 in 0.836s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:27 devstack sudo[99043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4
Jul 07 22:45:27 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:27 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" returned: 0 in 0.688s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "cinder-quobyte-1ab0f277-644e-4d11-aeb4-d5dac44d29f4" released by "delete_volume" :: held 1.583s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Created reservations ['560b8d5d-8dbd-4124-afbc-cc9afd681701', 'f8e97e00-769f-4ede-bd69-97514c55b8ca', '4fe4f8d7-44a5-4f79-aa28-80aabd1d1dac', '09654104-4aa1-47ae-bb8c-624341ff41ee'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:27 devstack sudo[99046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:45:27 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:27 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4" returned: 0 in 0.900s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:27 devstack sudo[99052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4
Jul 07 22:45:27 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:28 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.763s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:28 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:28 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Deleted volume successfully.
Jul 07 22:45:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3a6bb5-352b-472b-b963-dc08fe478ba9 tempest-SnapshotMetadataTestJSON-1549091916 None] Lock "cinder-1ab0f277-644e-4d11-aeb4-d5dac44d29f4-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:28 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764.c9c970ec-364a-4bcb-89fa-ca65051c62b4" returned: 0 in 0.840s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-quobyte-c9c970ec-364a-4bcb-89fa-ca65051c62b4" released by "_delete_snapshot" :: held 3.599s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-quobyte-e7e40863-425a-4253-9a10-603670b7c764" released by "delete_snapshot" :: held 3.625s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:28 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Created reservations ['265629f6-496d-4a8b-923c-bc16aed91794', '5426165e-0f85-4f0f-86a5-d7474b245aa6', 'f00ce5ad-1e49-44fd-bec3-457cb4799250', 'f41f0288-92dd-4bb7-b25e-49c5029c8341'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:28 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Delete snapshot completed successfully.
Jul 07 22:45:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02c0f3b3-485d-4a8a-8bba-9c865707629b tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-c9c970ec-364a-4bcb-89fa-ca65051c62b4-delete_snapshot" released by "delete_snapshot" :: held 3.830s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "cinder-e7e40863-425a-4253-9a10-603670b7c764-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-e7e40863-425a-4253-9a10-603670b7c764-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "cinder-quobyte-e7e40863-425a-4253-9a10-603670b7c764" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-quobyte-e7e40863-425a-4253-9a10-603670b7c764" acquired by "delete_volume" :: waited 0.037s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:29 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2806dc54-6153-401a-9cbd-a303ce4da6d2]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:29 devstack sudo[99056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764
Jul 07 22:45:29 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:30 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764" returned: 0 in 0.883s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:30 devstack sudo[99062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764
Jul 07 22:45:30 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:31 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e7e40863-425a-4253-9a10-603670b7c764" returned: 0 in 0.832s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-quobyte-e7e40863-425a-4253-9a10-603670b7c764" released by "delete_volume" :: held 1.801s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Created reservations ['2768ead9-1945-41c6-8b10-4ed3ed0623f2', '9e74a425-faad-49ed-8ddc-6dcb688577d3', 'bd2a213a-5ff6-49cd-a9be-f9cae8b732a7', '690b54c3-9bfa-4892-9d4a-6dfe7dbb9370'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:31 devstack sudo[99065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:45:31 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "cinder-6bc0fca0-a126-4e40-86e3-389e559ffb14-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-6bc0fca0-a126-4e40-86e3-389e559ffb14-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "cinder-quobyte-6bc0fca0-a126-4e40-86e3-389e559ffb14" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-quobyte-6bc0fca0-a126-4e40-86e3-389e559ffb14" acquired by "delete_volume" :: waited 0.041s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c21cfae-f04e-45dd-af8a-076be00e02df]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:32 devstack sudo[99082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14
Jul 07 22:45:32 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:32 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.020s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:32 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Deleted volume successfully.
Jul 07 22:45:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9df436ce-1e80-45ef-8a40-572f3263d981 tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-e7e40863-425a-4253-9a10-603670b7c764-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:33 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14" returned: 0 in 1.106s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:33 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14
Jul 07 22:45:33 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:33 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6bc0fca0-a126-4e40-86e3-389e559ffb14" returned: 0 in 0.681s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-quobyte-6bc0fca0-a126-4e40-86e3-389e559ffb14" released by "delete_volume" :: held 1.872s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Created reservations ['f3b15623-d296-4cae-bad5-051762c026cb', '0e655fe1-6310-40cd-a434-68ebff312da2', '02aab410-ec35-4384-a2c6-21d8ef97bbe1', '679ba95a-c86c-4187-bcd1-e7c0ff9d5fa7'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:33 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:45:33 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:34 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.764s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:34 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Deleted volume successfully.
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-301f8365-4361-4219-bb46-38a6c0d0e357 tempest-CinderUnicodeTest-1650782977 None] Lock "cinder-6bc0fca0-a126-4e40-86e3-389e559ffb14-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Flow 'volume_create_manager' (36e13667-7253-4b43-bb6e-f7fed767489d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe91450-9234-4708-a3a4-962972917c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe91450-9234-4708-a3a4-962972917c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1476039895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177b0434-cb41-457d-bd01-b7fbfd416333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff477a7890db4327abe321d53f565696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:35Z,use_quota=True,user_id='293e54818e21439bb1cd8fed15d79cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362cf4d8-4268-4502-a3b8-0c25c19b6313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (362cf4d8-4268-4502-a3b8-0c25c19b6313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0e7c2d-e8fe-47e0-8e1f-c9cb3af70bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0e7c2d-e8fe-47e0-8e1f-c9cb3af70bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '177b0434-cb41-457d-bd01-b7fbfd416333', 'volume_name': 'volume-177b0434-cb41-457d-bd01-b7fbfd416333', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fb0056-2f01-4fa2-a403-8b60c3f29bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fb0056-2f01-4fa2-a403-8b60c3f29bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986548fe-c723-4132-8188-f9e8566de2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:34 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Volume 177b0434-cb41-457d-bd01-b7fbfd416333: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-177b0434-cb41-457d-bd01-b7fbfd416333', 'volume_size': 1}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1476039895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177b0434-cb41-457d-bd01-b7fbfd416333,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff477a7890db4327abe321d53f565696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:35Z,use_quota=True,user_id='293e54818e21439bb1cd8fed15d79cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Creating volume 177b0434-cb41-457d-bd01-b7fbfd416333 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:34 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:45:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:34 devstack sudo[99094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333 1073741824
Jul 07 22:45:34 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:35 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333 1073741824" returned: 0 in 0.883s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:35 devstack sudo[99100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333
Jul 07 22:45:35 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:36 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333" returned: 0 in 0.678s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986548fe-c723-4132-8188-f9e8566de2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177b0434-cb41-457d-bd01-b7fbfd416333', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46aec313-fc05-4302-aad0-ecb698eb5ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:36 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Volume volume-177b0434-cb41-457d-bd01-b7fbfd416333 (177b0434-cb41-457d-bd01-b7fbfd416333): created successfully
Jul 07 22:45:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46aec313-fc05-4302-aad0-ecb698eb5ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Flow 'volume_create_manager' (36e13667-7253-4b43-bb6e-f7fed767489d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:36 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d8c09d6a-435e-441a-a8c4-71724bcff932 tempest-VolumesNegativeTest-915417825 None] Created volume successfully.
Jul 07 22:45:37 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Flow 'volume_create_manager' (1c9f366a-5d4d-4e2f-96b3-1078c8ca0d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af88374d-3b44-4dec-81db-59773023c36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af88374d-3b44-4dec-81db-59773023c36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058817026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694a3218-e92a-465f-996e-82087acf5788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1d2df9941f4821b01d7f89010849b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:38Z,use_quota=True,user_id='fea36a542c4d48d78e6e7a5a7b519d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9f4c48-ff1b-400e-bf67-c7f3636502d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9f4c48-ff1b-400e-bf67-c7f3636502d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7c74d2-f167-4e73-96e2-1ba7c1ecc15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b7c74d2-f167-4e73-96e2-1ba7c1ecc15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694a3218-e92a-465f-996e-82087acf5788', 'volume_name': 'volume-694a3218-e92a-465f-996e-82087acf5788', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41830f8-aa9b-4f00-b0dd-ffafa999f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41830f8-aa9b-4f00-b0dd-ffafa999f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ea69ad-8b04-4864-a4d1-e897a7c393c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:38 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Volume 694a3218-e92a-465f-996e-82087acf5788: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694a3218-e92a-465f-996e-82087acf5788', 'volume_size': 1}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1058817026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694a3218-e92a-465f-996e-82087acf5788,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1d2df9941f4821b01d7f89010849b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:38Z,use_quota=True,user_id='fea36a542c4d48d78e6e7a5a7b519d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Creating volume 694a3218-e92a-465f-996e-82087acf5788 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:38 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:45:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:38 devstack sudo[99106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788 1073741824
Jul 07 22:45:38 devstack sudo[99106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:39 devstack sudo[99106]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788 1073741824" returned: 0 in 1.011s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:39 devstack sudo[99111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788
Jul 07 22:45:39 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:39 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788" returned: 0 in 0.824s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49ea69ad-8b04-4864-a4d1-e897a7c393c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694a3218-e92a-465f-996e-82087acf5788', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e96ca7e-7fad-49fc-aef2-d962d5b8b009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:40 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Volume volume-694a3218-e92a-465f-996e-82087acf5788 (694a3218-e92a-465f-996e-82087acf5788): created successfully
Jul 07 22:45:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e96ca7e-7fad-49fc-aef2-d962d5b8b009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Flow 'volume_create_manager' (1c9f366a-5d4d-4e2f-96b3-1078c8ca0d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:40 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1df4d154-8d31-4a10-af51-bf2a8b939c59 tempest-ProjectReaderTests-426719820 None] Created volume successfully.
Jul 07 22:45:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Acquiring lock "cinder-694a3218-e92a-465f-996e-82087acf5788-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Lock "cinder-694a3218-e92a-465f-996e-82087acf5788-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Acquiring lock "cinder-quobyte-694a3218-e92a-465f-996e-82087acf5788" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Lock "cinder-quobyte-694a3218-e92a-465f-996e-82087acf5788" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:41 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadc8a3b-668b-482c-a59c-7eb5a10721f4]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:41 devstack sudo[99129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788
Jul 07 22:45:41 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:42 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788" returned: 0 in 0.861s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:42 devstack sudo[99136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788
Jul 07 22:45:42 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:43 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-694a3218-e92a-465f-996e-82087acf5788" returned: 0 in 0.932s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Lock "cinder-quobyte-694a3218-e92a-465f-996e-82087acf5788" released by "delete_volume" :: held 1.847s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Created reservations ['cee30294-9cfb-484a-be2d-60f5c195cf5b', 'a5815345-4588-4383-ab4a-48512770f903', '6c4bc49a-185a-4f84-b848-4fb34fc03a23', 'b78c0c62-bcd2-40f2-b95d-767bba5d612c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:43 devstack sudo[99140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:45:43 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:43 devstack sudo[99141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:45:43 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Flow 'volume_create_manager' (8de064a7-4a8b-48a2-8831-4ba4c538b6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83426692-ad0c-4251-9e73-b09a56e855d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83426692-ad0c-4251-9e73-b09a56e855d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412089646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c705d52e-0c11-4217-a50c-47752c855496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1d2df9941f4821b01d7f89010849b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:44Z,use_quota=True,user_id='fea36a542c4d48d78e6e7a5a7b519d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36165ed-d462-483b-9937-4d81c49a6858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36165ed-d462-483b-9937-4d81c49a6858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29b2f08-fd4b-4653-bd56-7acffd6caad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29b2f08-fd4b-4653-bd56-7acffd6caad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c705d52e-0c11-4217-a50c-47752c855496', 'volume_name': 'volume-c705d52e-0c11-4217-a50c-47752c855496', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:44 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c50168-96d2-4a81-a645-ef9e72003976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c50168-96d2-4a81-a645-ef9e72003976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a23b3b1-6e65-47a5-a233-df51c1cf0916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:44 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Volume c705d52e-0c11-4217-a50c-47752c855496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c705d52e-0c11-4217-a50c-47752c855496', 'volume_size': 1}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1412089646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c705d52e-0c11-4217-a50c-47752c855496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1d2df9941f4821b01d7f89010849b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:44Z,use_quota=True,user_id='fea36a542c4d48d78e6e7a5a7b519d58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Creating volume c705d52e-0c11-4217-a50c-47752c855496 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:44 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:44 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.308s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.310s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:44 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Deleted volume successfully.
Jul 07 22:45:44 devstack sudo[99165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496 1073741824
Jul 07 22:45:44 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e3728fa-d328-46d9-adbf-2428f68e355d tempest-ProjectReaderTests-426719820 None] Lock "cinder-694a3218-e92a-465f-996e-82087acf5788-delete_volume" released by "delete_volume" :: held 3.568s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:45:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:45:46 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496 1073741824" returned: 0 in 1.340s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:46 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496
Jul 07 22:45:46 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:46 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496" returned: 0 in 0.829s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a23b3b1-6e65-47a5-a233-df51c1cf0916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c705d52e-0c11-4217-a50c-47752c855496', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cdf9cc3-5992-407b-8e40-40525924eaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:47 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Volume volume-c705d52e-0c11-4217-a50c-47752c855496 (c705d52e-0c11-4217-a50c-47752c855496): created successfully
Jul 07 22:45:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cdf9cc3-5992-407b-8e40-40525924eaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Flow 'volume_create_manager' (8de064a7-4a8b-48a2-8831-4ba4c538b6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0349d6ed-1684-469b-802c-e8698bfb78f5 tempest-ProjectReaderTests-426719820 None] Created volume successfully.
Jul 07 22:45:47 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Acquiring lock "cinder-c705d52e-0c11-4217-a50c-47752c855496-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:47 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Lock "cinder-c705d52e-0c11-4217-a50c-47752c855496-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:47 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:INSERT=33,cinder:UPDATE=136,cinder:DELETE=9,cinder:SELECT=99 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:45:47 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Acquiring lock "cinder-quobyte-c705d52e-0c11-4217-a50c-47752c855496" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:47 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Lock "cinder-quobyte-c705d52e-0c11-4217-a50c-47752c855496" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:47 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9141d4-bb7c-4aff-8eba-33dab42b512e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:47 devstack sudo[99207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496
Jul 07 22:45:47 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:48 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496" returned: 0 in 0.819s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:48 devstack sudo[99212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496
Jul 07 22:45:48 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:49 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c705d52e-0c11-4217-a50c-47752c855496" returned: 0 in 0.693s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Lock "cinder-quobyte-c705d52e-0c11-4217-a50c-47752c855496" released by "delete_volume" :: held 1.562s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:49 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Created reservations ['1a551a09-28e1-4875-988c-8582c3ce86d7', '7be8bac2-fd06-449b-89ab-58274e0512fa', '19d35b31-c72c-4ab1-8b2a-a0d593f16433', '64b169df-7c83-478d-9174-572d3bcebaeb'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:49 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:45:49 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:50 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.170s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:50 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:50 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Deleted volume successfully.
Jul 07 22:45:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e5ede80f-f886-4af0-a0f8-97beae9d3470 tempest-ProjectReaderTests-426719820 None] Lock "cinder-c705d52e-0c11-4217-a50c-47752c855496-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:55 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=106,cinder:UPDATE=134,cinder:DELETE=13,cinder:INSERT=44 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:45:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-a14fa9f3-ca23-4c3c-a7b2-2880882faa9c req-bfa23316-f256-4330-8ab9-da7775a5f098 tempest-AttachVolumeNegativeTest-1880869948 None] Terminate volume connection completed successfully.
Jul 07 22:45:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-a14fa9f3-ca23-4c3c-a7b2-2880882faa9c req-bfa23316-f256-4330-8ab9-da7775a5f098 tempest-AttachVolumeNegativeTest-1880869948 None] Deleting attachment 6c7fcba9-4eb0-4dd4-acfe-1a31609b94b7. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:46:05 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:46:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Acquiring lock "cinder-177b0434-cb41-457d-bd01-b7fbfd416333-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Lock "cinder-177b0434-cb41-457d-bd01-b7fbfd416333-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Acquiring lock "cinder-quobyte-177b0434-cb41-457d-bd01-b7fbfd416333" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Lock "cinder-quobyte-177b0434-cb41-457d-bd01-b7fbfd416333" acquired by "delete_volume" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:10 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4c63b0-3094-421d-9ac8-79a99f8f3a01]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:10 devstack sudo[99346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333
Jul 07 22:46:10 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:11 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333" returned: 0 in 0.882s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:11 devstack sudo[99352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333
Jul 07 22:46:11 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:12 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-177b0434-cb41-457d-bd01-b7fbfd416333" returned: 0 in 0.689s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Lock "cinder-quobyte-177b0434-cb41-457d-bd01-b7fbfd416333" released by "delete_volume" :: held 1.651s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:12 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Created reservations ['27e97c7d-a8d9-41a7-b8bd-8bb86c91f366', '8ba42747-95c3-4614-8a98-8a5a8afc3237', '540ec6f7-2143-47db-aab7-9e030bb4dddc', 'fa4aa4f1-e5e0-426e-89e3-007761d034ac'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:46:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:12 devstack sudo[99355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:46:12 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:13 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.879s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:13 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:46:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Deleted volume successfully.
Jul 07 22:46:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7d2fdf12-1f70-45e8-9627-8e218eb5c86a tempest-VolumesNegativeTest-915417825 None] Lock "cinder-177b0434-cb41-457d-bd01-b7fbfd416333-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Flow 'volume_create_manager' (b067451f-0be3-4acb-974c-2ad1f28cc2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ffd92b-607e-40e8-afeb-77355c8e3090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77ffd92b-607e-40e8-afeb-77355c8e3090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1957407267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3304f517-5d7a-478a-b39e-5b02475d0d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947ca83166514d32b579ca7a04af1375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:22Z,use_quota=True,user_id='0a1d53d99f4e4aa88748ac4a0da0fc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abafc89-21f0-4129-87e0-f874fb2d8e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5abafc89-21f0-4129-87e0-f874fb2d8e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd5ae01-43f4-407c-8338-2621cbecc5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd5ae01-43f4-407c-8338-2621cbecc5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3304f517-5d7a-478a-b39e-5b02475d0d44', 'volume_name': 'volume-3304f517-5d7a-478a-b39e-5b02475d0d44', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f4fa41-f6a2-4798-81aa-175b6158f4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f4fa41-f6a2-4798-81aa-175b6158f4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6ffc4e-6e4a-4804-b434-f1c02092ddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:21 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Volume 3304f517-5d7a-478a-b39e-5b02475d0d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3304f517-5d7a-478a-b39e-5b02475d0d44', 'volume_size': 1}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1957407267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3304f517-5d7a-478a-b39e-5b02475d0d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947ca83166514d32b579ca7a04af1375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:22Z,use_quota=True,user_id='0a1d53d99f4e4aa88748ac4a0da0fc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Creating volume 3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:46:21 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:46:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:21 devstack sudo[99414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 1073741824
Jul 07 22:46:21 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:22 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 1073741824" returned: 0 in 1.076s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:22 devstack sudo[99420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44
Jul 07 22:46:22 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:23 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44" returned: 0 in 0.847s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:46:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.981s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6ffc4e-6e4a-4804-b434-f1c02092ddff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3304f517-5d7a-478a-b39e-5b02475d0d44', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf8bd60-c364-4cd3-94ba-6db4be00a257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:23 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Volume volume-3304f517-5d7a-478a-b39e-5b02475d0d44 (3304f517-5d7a-478a-b39e-5b02475d0d44): created successfully
Jul 07 22:46:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baf8bd60-c364-4cd3-94ba-6db4be00a257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Flow 'volume_create_manager' (b067451f-0be3-4acb-974c-2ad1f28cc2dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:23 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-83423712-1611-4c8c-99ca-39109ba786f9 tempest-SnapshotDependencyTests-1649675825 None] Created volume successfully.
Jul 07 22:46:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Creating offline snapshot 3a5ae9dc-35da-4175-984b-9b1d921bc6b6 of volume 3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:46:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[40daedef-aae2-4da0-add1-64424b6a890b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:25 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44
Jul 07 22:46:25 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:26 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44" returned: 0 in 0.881s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:26 devstack sudo[99431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 1G
Jul 07 22:46:26 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:27 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 1G" returned: 0 in 1.176s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3304f517-5d7a-478a-b39e-5b02475d0d44 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:27 devstack sudo[99437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3304f517-5d7a-478a-b39e-5b02475d0d44 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6
Jul 07 22:46:27 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:28 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3304f517-5d7a-478a-b39e-5b02475d0d44 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6" returned: 0 in 0.855s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:28 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 is being set with open permissions: ugo+rw
Jul 07 22:46:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:28 devstack sudo[99442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6
Jul 07 22:46:28 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:29 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6" returned: 0 in 0.871s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:29 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.info
Jul 07 22:46:29 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:29 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.info" returned: 0 in 0.720s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:29 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.info is being set with open permissions: ugo+rw
Jul 07 22:46:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:29 devstack sudo[99449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.info
Jul 07 22:46:29 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:30 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.info" returned: 0 in 0.953s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.605s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:30 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8cdaed95-e3fa-434a-bb66-923ea3d2711c tempest-SnapshotDependencyTests-1649675825 None] Create snapshot completed successfully
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Flow 'volume_create_manager' (75999d89-7b3d-499c-aeac-d4c21caa0234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a0223a-a085-4631-868a-4baabbd20c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a0223a-a085-4631-868a-4baabbd20c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240a554f-1415-483f-8f96-b5f14e8add76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947ca83166514d32b579ca7a04af1375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a5ae9dc-35da-4175-984b-9b1d921bc6b6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:32Z,use_quota=True,user_id='0a1d53d99f4e4aa88748ac4a0da0fc17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd9b863-6705-4dfd-b368-88c2a2ac7b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dd9b863-6705-4dfd-b368-88c2a2ac7b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c625e0f1-feee-41b9-b200-9403f7b9cf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c625e0f1-feee-41b9-b200-9403f7b9cf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '240a554f-1415-483f-8f96-b5f14e8add76', 'volume_name': 'volume-240a554f-1415-483f-8f96-b5f14e8add76', 'volume_size': 1, 'snapshot_id': '3a5ae9dc-35da-4175-984b-9b1d921bc6b6'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3a4279-328b-43b6-a8f3-b4241fa2b885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3a4279-328b-43b6-a8f3-b4241fa2b885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d643bd-b2fd-4991-aa52-1265c5de537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:32 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Volume 240a554f-1415-483f-8f96-b5f14e8add76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-240a554f-1415-483f-8f96-b5f14e8add76', 'volume_size': 1, 'snapshot_id': '3a5ae9dc-35da-4175-984b-9b1d921bc6b6'}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "cinder-quobyte-3a5ae9dc-35da-4175-984b-9b1d921bc6b6-240a554f-1415-483f-8f96-b5f14e8add76" by "_create_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-3a5ae9dc-35da-4175-984b-9b1d921bc6b6-240a554f-1415-483f-8f96-b5f14e8add76" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Creating volume 240a554f-1415-483f-8f96-b5f14e8add76 from snapshot 3a5ae9dc-35da-4175-984b-9b1d921bc6b6 {{(pid=88077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "cinder-quobyte-240a554f-1415-483f-8f96-b5f14e8add76" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-240a554f-1415-483f-8f96-b5f14e8add76" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] snapshot: 3a5ae9dc-35da-4175-984b-9b1d921bc6b6, volume: 240a554f-1415-483f-8f96-b5f14e8add76,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6778cce8-315d-461b-9668-fc18919d85d9]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:32 devstack sudo[99517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6
Jul 07 22:46:32 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:33 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6" returned: 0 in 1.048s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3304f517-5d7a-478a-b39e-5b02475d0d44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:46:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:46:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:46:33 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2347121f-0a9b-4b10-a862-9100696f642d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:33 devstack sudo[99522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44
Jul 07 22:46:33 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:34 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44" returned: 0 in 0.982s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:34 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76 not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:46:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:34 devstack sudo[99527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76
Jul 07 22:46:34 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:40 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76" returned: 0 in 5.948s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:40 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5abbee7-5b4c-4e92-9beb-6d414e671400]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:40 devstack sudo[99541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44
Jul 07 22:46:40 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:42 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44" returned: 0 in 1.374s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:42 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:46:42 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Converted 1024.00 MB image at 172.12 MB/s
Jul 07 22:46:42 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76 is being set with open permissions: ugo+rw
Jul 07 22:46:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:42 devstack sudo[99550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76
Jul 07 22:46:42 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:42 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=16,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:46:42 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:46:43 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76" returned: 0 in 0.995s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-240a554f-1415-483f-8f96-b5f14e8add76" released by "_copy_volume_from_snapshot" :: held 10.520s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-3a5ae9dc-35da-4175-984b-9b1d921bc6b6-240a554f-1415-483f-8f96-b5f14e8add76" released by "_create_volume_from_snapshot" :: held 10.568s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.591s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d643bd-b2fd-4991-aa52-1265c5de537e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240a554f-1415-483f-8f96-b5f14e8add76', 'volume_size': 1, 'snapshot_id': '3a5ae9dc-35da-4175-984b-9b1d921bc6b6'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc7f3ab-ff5c-4bf3-ae67-4b7758b4d3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:43 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Volume volume-240a554f-1415-483f-8f96-b5f14e8add76 (240a554f-1415-483f-8f96-b5f14e8add76): created successfully
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbc7f3ab-ff5c-4bf3-ae67-4b7758b4d3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Flow 'volume_create_manager' (75999d89-7b3d-499c-aeac-d4c21caa0234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d3ee93a0-81d7-4f2f-9b5d-2f919f968c26 tempest-SnapshotDependencyTests-1649675825 None] Created volume successfully.
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:43 devstack sudo[99553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:46:43 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "cinder-3a5ae9dc-35da-4175-984b-9b1d921bc6b6-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-3a5ae9dc-35da-4175-984b-9b1d921bc6b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "cinder-quobyte-3304f517-5d7a-478a-b39e-5b02475d0d44" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-3304f517-5d7a-478a-b39e-5b02475d0d44" acquired by "delete_snapshot" :: waited 0.060s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "cinder-quobyte-3a5ae9dc-35da-4175-984b-9b1d921bc6b6" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-3a5ae9dc-35da-4175-984b-9b1d921bc6b6" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Deleting offline snapshot 3a5ae9dc-35da-4175-984b-9b1d921bc6b6 of volume 3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] snapshot_file for this snap is: volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[476759f1-71ac-4bbd-9e1f-72b42cee0cc7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:44 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.102s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:46:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:46:44 devstack sudo[99563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6
Jul 07 22:46:44 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:45 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6" returned: 0 in 1.087s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3304f517-5d7a-478a-b39e-5b02475d0d44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:46:45 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[432d4074-6915-4965-8a13-68166123a63a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:45 devstack sudo[99568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44
Jul 07 22:46:45 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:46 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44" returned: 0 in 0.956s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:46 devstack sudo[99574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6
Jul 07 22:46:46 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:47 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6" returned: 0 in 0.898s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:47 devstack sudo[99582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6
Jul 07 22:46:47 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:48 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44.3a5ae9dc-35da-4175-984b-9b1d921bc6b6" returned: 0 in 0.740s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-3a5ae9dc-35da-4175-984b-9b1d921bc6b6" released by "_delete_snapshot" :: held 3.860s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-3304f517-5d7a-478a-b39e-5b02475d0d44" released by "delete_snapshot" :: held 3.905s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Created reservations ['7488e394-b10f-46e5-8c7c-678f5a315b77', '9f4ba6f9-feae-429e-b917-794892f9f771', '9fedf089-b5c3-48b9-ad23-5dd9d4887ce3', 'ff6cef2f-9783-4148-b95d-b37c6349e1eb'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:46:48 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Delete snapshot completed successfully.
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9457c516-1021-4322-b55f-f5aa142a0921 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-3a5ae9dc-35da-4175-984b-9b1d921bc6b6-delete_snapshot" released by "delete_snapshot" :: held 4.103s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "cinder-3304f517-5d7a-478a-b39e-5b02475d0d44-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-3304f517-5d7a-478a-b39e-5b02475d0d44-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "cinder-quobyte-3304f517-5d7a-478a-b39e-5b02475d0d44" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-3304f517-5d7a-478a-b39e-5b02475d0d44" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[77656a08-4200-44eb-afdc-73c5e7ce46cc]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:48 devstack sudo[99586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44
Jul 07 22:46:48 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:49 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44" returned: 0 in 0.757s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:49 devstack sudo[99591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44
Jul 07 22:46:49 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:50 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3304f517-5d7a-478a-b39e-5b02475d0d44" returned: 0 in 0.642s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-3304f517-5d7a-478a-b39e-5b02475d0d44" released by "delete_volume" :: held 1.455s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Created reservations ['fde3a67e-6a1f-4e30-87be-36b760b18e9a', '383aebf5-32e9-4e3e-b371-5ae9193a5749', 'd82595c9-c4bd-4410-be84-9b6f5f847b31', 'bb47470a-074d-47c0-a04b-9b2060c8d355'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:50 devstack sudo[99594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:46:50 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "cinder-240a554f-1415-483f-8f96-b5f14e8add76-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-240a554f-1415-483f-8f96-b5f14e8add76-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:50 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "cinder-quobyte-240a554f-1415-483f-8f96-b5f14e8add76" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.699s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:46:50 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Deleted volume successfully.
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-240a554f-1415-483f-8f96-b5f14e8add76" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b87c1068-f324-4bc1-bd06-5d360583f4d6 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-3304f517-5d7a-478a-b39e-5b02475d0d44-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f2d52b-006a-4b73-85ca-74fdaf11f6ed]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:51 devstack sudo[99598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76
Jul 07 22:46:51 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:51 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76" returned: 0 in 0.886s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:51 devstack sudo[99604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76
Jul 07 22:46:51 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:52 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-240a554f-1415-483f-8f96-b5f14e8add76" returned: 0 in 0.765s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-quobyte-240a554f-1415-483f-8f96-b5f14e8add76" released by "delete_volume" :: held 1.734s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:52 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Created reservations ['b7abe8eb-10ba-4357-a3d7-8ce3146f17bd', '658b06c6-2a07-49a8-ab2d-e90d1beb2f9f', 'b3c897bf-02cd-42d9-b8cc-86b37ecb5620', '82be6503-ac3a-455d-9998-400b549e822a'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:46:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:52 devstack sudo[99607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:46:52 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:53 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.970s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:53 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:46:53 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Deleted volume successfully.
Jul 07 22:46:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ec3e4c39-8019-4352-a53e-a71335be7e88 tempest-SnapshotDependencyTests-1649675825 None] Lock "cinder-240a554f-1415-483f-8f96-b5f14e8add76-delete_volume" released by "delete_volume" :: held 3.025s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:05 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Flow 'volume_create_manager' (d9e8d5d1-71de-4df0-9d8e-0066d40bdd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b6887b-126f-43a0-94ad-3d1cda88b43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b6887b-126f-43a0-94ad-3d1cda88b43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1179844188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbdb738-c846-4679-bc4e-c41e307fb3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b947282df924832ba4db4fb99371bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:06Z,use_quota=True,user_id='b26594037cd640b4945efbaab6fe8998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8636ddde-0279-4609-b4c9-60c36aa60137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8636ddde-0279-4609-b4c9-60c36aa60137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129edb43-2423-4189-a8ee-eb88be176e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129edb43-2423-4189-a8ee-eb88be176e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fbdb738-c846-4679-bc4e-c41e307fb3e9', 'volume_name': 'volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b90fee7-191e-4307-9d0b-327945da56b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b90fee7-191e-4307-9d0b-327945da56b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e4857c-084c-4a66-84d5-2a0fe0ef5221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:06 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Volume 6fbdb738-c846-4679-bc4e-c41e307fb3e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9', 'volume_size': 1}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1179844188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbdb738-c846-4679-bc4e-c41e307fb3e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b947282df924832ba4db4fb99371bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:06Z,use_quota=True,user_id='b26594037cd640b4945efbaab6fe8998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Creating volume 6fbdb738-c846-4679-bc4e-c41e307fb3e9 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:06 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:47:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:06 devstack sudo[99724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9 1073741824
Jul 07 22:47:06 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:07 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9 1073741824" returned: 0 in 0.978s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:07 devstack sudo[99729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9
Jul 07 22:47:07 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:07 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9" returned: 0 in 0.666s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e4857c-084c-4a66-84d5-2a0fe0ef5221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd379f0-e35f-4367-b899-e59a933ddd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:07 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Volume volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9 (6fbdb738-c846-4679-bc4e-c41e307fb3e9): created successfully
Jul 07 22:47:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd379f0-e35f-4367-b899-e59a933ddd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Flow 'volume_create_manager' (d9e8d5d1-71de-4df0-9d8e-0066d40bdd85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:07 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-41fee024-c160-4b33-8fc3-67d42dce3451 tempest-AttachVolumeNegativeTest-1880869948 None] Created volume successfully.
Jul 07 22:47:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-3ed7adb0-e804-4971-821c-b60b8168c386 req-e7a64aa6-cdef-43c2-bf6b-7b6daa472e06 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-3ed7adb0-e804-4971-821c-b60b8168c386 req-e7a64aa6-cdef-43c2-bf6b-7b6daa472e06 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[87add2c1-c94a-49d2-944b-64182adbcf51]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-3ed7adb0-e804-4971-821c-b60b8168c386 req-e7a64aa6-cdef-43c2-bf6b-7b6daa472e06 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:11 devstack sudo[99746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9
Jul 07 22:47:11 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:12 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-3ed7adb0-e804-4971-821c-b60b8168c386 req-e7a64aa6-cdef-43c2-bf6b-7b6daa472e06 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9" returned: 0 in 0.827s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-3ed7adb0-e804-4971-821c-b60b8168c386 req-e7a64aa6-cdef-43c2-bf6b-7b6daa472e06 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.844s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-3ed7adb0-e804-4971-821c-b60b8168c386 req-e7a64aa6-cdef-43c2-bf6b-7b6daa472e06 tempest-AttachVolumeNegativeTest-1880869948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3b187f08-ec54-4cc2-af2b-42a849555e9c', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:47:12 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-3ed7adb0-e804-4971-821c-b60b8168c386 req-e7a64aa6-cdef-43c2-bf6b-7b6daa472e06 tempest-AttachVolumeNegativeTest-1880869948 None] attachment_update completed successfully.
Jul 07 22:47:18 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-f98146b5-4db4-4ba4-918f-42b6caa802a1 req-386c66ec-e444-47db-9700-e472991aed3a tempest-AttachVolumeNegativeTest-1880869948 None] Terminate volume connection completed successfully.
Jul 07 22:47:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-f98146b5-4db4-4ba4-918f-42b6caa802a1 req-386c66ec-e444-47db-9700-e472991aed3a tempest-AttachVolumeNegativeTest-1880869948 None] Deleting attachment 3b187f08-ec54-4cc2-af2b-42a849555e9c. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:47:22 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=20,cinder:UPDATE=27,cinder:DELETE=4,cinder:INSERT=7 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Flow 'volume_create_manager' (bed64ca5-8b2d-43b2-8f3c-4725e43965cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066cb993-4a73-4f8a-95f8-013ebba0ec3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066cb993-4a73-4f8a-95f8-013ebba0ec3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-631212753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86839cd5-0bd2-458f-a2a2-a11b88dc206f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4c0873b77149e1b5b893b1a4fa898e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:25Z,use_quota=True,user_id='43c870227e5b4b0fbd6da48cba678638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e0f6c8-05d8-4c39-a05d-ae91d1a1318f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e0f6c8-05d8-4c39-a05d-ae91d1a1318f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21902d87-b90e-458d-a0a2-66358246bc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21902d87-b90e-458d-a0a2-66358246bc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86839cd5-0bd2-458f-a2a2-a11b88dc206f', 'volume_name': 'volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb487db-14ac-4bd4-b947-45ddf7ba8975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb487db-14ac-4bd4-b947-45ddf7ba8975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0229cf-89d2-4efd-b41d-dc93d7a1dc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:24 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Volume 86839cd5-0bd2-458f-a2a2-a11b88dc206f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f', 'volume_size': 1}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-631212753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86839cd5-0bd2-458f-a2a2-a11b88dc206f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be4c0873b77149e1b5b893b1a4fa898e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:25Z,use_quota=True,user_id='43c870227e5b4b0fbd6da48cba678638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Creating volume 86839cd5-0bd2-458f-a2a2-a11b88dc206f {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:24 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:47:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:24 devstack sudo[100258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f 1073741824
Jul 07 22:47:24 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:25 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f 1073741824" returned: 0 in 0.915s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:25 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f
Jul 07 22:47:25 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:26 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f" returned: 0 in 0.687s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d0229cf-89d2-4efd-b41d-dc93d7a1dc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93715087-3fe1-4a12-8346-80f703a88f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:26 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Volume volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f (86839cd5-0bd2-458f-a2a2-a11b88dc206f): created successfully
Jul 07 22:47:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93715087-3fe1-4a12-8346-80f703a88f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Flow 'volume_create_manager' (bed64ca5-8b2d-43b2-8f3c-4725e43965cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9868f293-f3bc-4a89-a8f5-757a6a8f0e41 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Created volume successfully.
Jul 07 22:47:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-0c31f0f5-4025-44a8-a732-27a9909711e2 req-6bdb89cf-3f81-4cbf-b545-ce146a8b0aa8 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-0c31f0f5-4025-44a8-a732-27a9909711e2 req-6bdb89cf-3f81-4cbf-b545-ce146a8b0aa8 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:30 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b706f48e-db19-47f4-994a-35f79be38243]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-0c31f0f5-4025-44a8-a732-27a9909711e2 req-6bdb89cf-3f81-4cbf-b545-ce146a8b0aa8 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:30 devstack sudo[100278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f
Jul 07 22:47:30 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:30 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-0c31f0f5-4025-44a8-a732-27a9909711e2 req-6bdb89cf-3f81-4cbf-b545-ce146a8b0aa8 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f" returned: 0 in 0.807s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-0c31f0f5-4025-44a8-a732-27a9909711e2 req-6bdb89cf-3f81-4cbf-b545-ce146a8b0aa8 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.833s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-0c31f0f5-4025-44a8-a732-27a9909711e2 req-6bdb89cf-3f81-4cbf-b545-ce146a8b0aa8 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6d6660d-5e4d-47a5-9210-1a3ac0eefc13', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:47:31 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-0c31f0f5-4025-44a8-a732-27a9909711e2 req-6bdb89cf-3f81-4cbf-b545-ce146a8b0aa8 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] attachment_update completed successfully.
Jul 07 22:47:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-11493fb4-c410-4ff8-8db5-0ce754f70d9f req-b6d43c73-5353-468d-a1b1-0d7b8dac97bc tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Terminate volume connection completed successfully.
Jul 07 22:47:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-11493fb4-c410-4ff8-8db5-0ce754f70d9f req-b6d43c73-5353-468d-a1b1-0d7b8dac97bc tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Deleting attachment a6d6660d-5e4d-47a5-9210-1a3ac0eefc13. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:47:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Acquiring lock "cinder-86839cd5-0bd2-458f-a2a2-a11b88dc206f-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "cinder-86839cd5-0bd2-458f-a2a2-a11b88dc206f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Acquiring lock "cinder-quobyte-86839cd5-0bd2-458f-a2a2-a11b88dc206f" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "cinder-quobyte-86839cd5-0bd2-458f-a2a2-a11b88dc206f" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:39 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cef138-68ca-4c16-ace6-f5d24a0b6c64]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:39 devstack sudo[100713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f
Jul 07 22:47:39 devstack sudo[100713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:40 devstack sudo[100713]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f" returned: 0 in 0.835s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:40 devstack sudo[100718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f
Jul 07 22:47:40 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:40 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-86839cd5-0bd2-458f-a2a2-a11b88dc206f" returned: 0 in 0.667s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "cinder-quobyte-86839cd5-0bd2-458f-a2a2-a11b88dc206f" released by "delete_volume" :: held 1.553s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:41 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Created reservations ['748d5818-84d8-4428-8aee-d02f1665714a', '7d8c7f36-3902-4be0-98d2-ab10dda55b16', '393cce4a-c4ae-45f5-b2ce-2efdde386132', '7c39bb90-f460-4b8c-a754-c49ecba66ee1'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:41 devstack sudo[100722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:47:41 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:41 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.702s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:41 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:41 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Deleted volume successfully.
Jul 07 22:47:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b4da5252-a89d-45f4-96f1-877be68fe511 tempest-TestServerVolumeAttachScenarioOldVersion-730394357 None] Lock "cinder-86839cd5-0bd2-458f-a2a2-a11b88dc206f-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:47:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:43 devstack sudo[100777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:47:43 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:44 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.864s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:47:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:47:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:47:51 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=13,cinder:SELECT=13,cinder:INSERT=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:47:51 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=41,cinder:SELECT=44,cinder:INSERT=9,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (51a7745f-82a5-4ef2-8102-d852335f279e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4b792e-1230-40e7-807c-6378cf600644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4b792e-1230-40e7-807c-6378cf600644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1379087601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157ac422-0148-466c-9edb-004f9a35d497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:01Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a334a94-60e9-44f4-8a5b-4b2cc12ef6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a334a94-60e9-44f4-8a5b-4b2cc12ef6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccc0d88-b131-46d4-8e14-5478a4b5cf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccc0d88-b131-46d4-8e14-5478a4b5cf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157ac422-0148-466c-9edb-004f9a35d497', 'volume_name': 'volume-157ac422-0148-466c-9edb-004f9a35d497', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2f4719-56c1-4705-b090-0e10d7c7a084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d2f4719-56c1-4705-b090-0e10d7c7a084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4994bd-4875-4220-a5e2-8b268ba75f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:01 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume 157ac422-0148-466c-9edb-004f9a35d497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157ac422-0148-466c-9edb-004f9a35d497', 'volume_size': 1}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1379087601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157ac422-0148-466c-9edb-004f9a35d497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:01Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Creating volume 157ac422-0148-466c-9edb-004f9a35d497 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:01 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:01 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497 1073741824
Jul 07 22:48:01 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:02 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497 1073741824" returned: 0 in 0.859s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:02 devstack sudo[100860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497
Jul 07 22:48:02 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:02 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497" returned: 0 in 0.645s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c4994bd-4875-4220-a5e2-8b268ba75f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157ac422-0148-466c-9edb-004f9a35d497', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b976146f-2428-47a3-94a2-e2912dbfe488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:02 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume volume-157ac422-0148-466c-9edb-004f9a35d497 (157ac422-0148-466c-9edb-004f9a35d497): created successfully
Jul 07 22:48:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b976146f-2428-47a3-94a2-e2912dbfe488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (51a7745f-82a5-4ef2-8102-d852335f279e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b5974fa5-28fa-40aa-b325-309921574a6b tempest-CreateVolumesFromSnapshotTest-979545844 None] Created volume successfully.
Jul 07 22:48:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Creating offline snapshot 427923b7-c03d-4880-85e5-30f163f9769a of volume 157ac422-0148-466c-9edb-004f9a35d497 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:48:03 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b893ce4-2734-45d5-a371-5f120fa70947]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:03 devstack sudo[100863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497
Jul 07 22:48:03 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:04 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497" returned: 0 in 0.763s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:04 devstack sudo[100868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a 1G
Jul 07 22:48:04 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:05 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a 1G" returned: 0 in 0.829s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157ac422-0148-466c-9edb-004f9a35d497 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:05 devstack sudo[100873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157ac422-0148-466c-9edb-004f9a35d497 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a
Jul 07 22:48:05 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:05 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-157ac422-0148-466c-9edb-004f9a35d497 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a" returned: 0 in 0.715s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:05 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a is being set with open permissions: ugo+rw
Jul 07 22:48:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:05 devstack sudo[100878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a
Jul 07 22:48:05 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:06 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a" returned: 0 in 0.621s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:06 devstack sudo[100881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.info
Jul 07 22:48:06 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:07 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.info" returned: 0 in 0.640s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:07 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.info is being set with open permissions: ugo+rw
Jul 07 22:48:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:07 devstack sudo[100884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.info
Jul 07 22:48:07 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:07 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.info" returned: 0 in 0.634s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.303s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:07 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3eb1c158-1143-471c-94a9-2210feb5a59a tempest-CreateVolumesFromSnapshotTest-979545844 None] Create snapshot completed successfully
Jul 07 22:48:08 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Flow 'volume_create_manager' (bb351daa-ff71-4311-a772-23f3b03ff7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8415641b-32e9-4834-bd8f-4a420b496b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8415641b-32e9-4834-bd8f-4a420b496b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-441634780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc73aed-63dd-49a0-8730-3d0c26f33acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b947282df924832ba4db4fb99371bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:09Z,use_quota=True,user_id='b26594037cd640b4945efbaab6fe8998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15930e9b-6819-471c-8cd1-06a1c9aea4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15930e9b-6819-471c-8cd1-06a1c9aea4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ec1683-f83a-4f6e-a73e-294b67c58e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ec1683-f83a-4f6e-a73e-294b67c58e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dc73aed-63dd-49a0-8730-3d0c26f33acf', 'volume_name': 'volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e90acbf-b8d3-4547-9f7a-d751e54357ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e90acbf-b8d3-4547-9f7a-d751e54357ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91355396-76be-465e-b382-d7d5d84fb134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Volume 5dc73aed-63dd-49a0-8730-3d0c26f33acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf', 'volume_size': 1}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-441634780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dc73aed-63dd-49a0-8730-3d0c26f33acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b947282df924832ba4db4fb99371bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:09Z,use_quota=True,user_id='b26594037cd640b4945efbaab6fe8998',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Creating volume 5dc73aed-63dd-49a0-8730-3d0c26f33acf {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:09 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:09 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf 1073741824
Jul 07 22:48:09 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (79a74b9c-a815-44ca-9afa-916844c47298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee71ebc-59a4-456e-98b9-48368b0488e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee71ebc-59a4-456e-98b9-48368b0488e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1493742992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b48242-b059-424c-8b1c-3a8e5eb14489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:09Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e1797f-8b73-40b9-8b0f-c0374fd10e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e1797f-8b73-40b9-8b0f-c0374fd10e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d48561-18d9-4601-a7d3-3c36c749a5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d48561-18d9-4601-a7d3-3c36c749a5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b48242-b059-424c-8b1c-3a8e5eb14489', 'volume_name': 'volume-c8b48242-b059-424c-8b1c-3a8e5eb14489', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c9f9b7-ed11-46ed-8db5-2a1b7bc05717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c9f9b7-ed11-46ed-8db5-2a1b7bc05717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845e64d3-73d2-4152-a1f5-bc90025ff663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume c8b48242-b059-424c-8b1c-3a8e5eb14489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b48242-b059-424c-8b1c-3a8e5eb14489', 'volume_size': 1}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (34b35ed0-1180-4fe5-9ef8-68c9d28791d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57546f4f-5f8f-44d5-83a3-caf3ce17defc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57546f4f-5f8f-44d5-83a3-caf3ce17defc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-743244344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a12edd-75fa-4a6b-ba42-9ac00d3cf173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:10Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98aa4fde-f96b-43e8-b583-ef784bf318cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98aa4fde-f96b-43e8-b583-ef784bf318cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a0b824-5389-4523-874c-8943767dbc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a0b824-5389-4523-874c-8943767dbc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a12edd-75fa-4a6b-ba42-9ac00d3cf173', 'volume_name': 'volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3cc1f3-386c-4ca6-8209-ffde6a5e1d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3cc1f3-386c-4ca6-8209-ffde6a5e1d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c244e1e-89ba-464b-a804-0855b452ef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:09 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume 67a12edd-75fa-4a6b-ba42-9ac00d3cf173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173', 'volume_size': 1}
Jul 07 22:48:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:10 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (0c4aa800-eb8d-434a-9266-59cc9f2db855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f90cf9f-8a97-4e8d-bf35-ba1dc31f8c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf 1073741824" returned: 0 in 1.085s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f90cf9f-8a97-4e8d-bf35-ba1dc31f8c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1946342762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f0d4a0-e87d-4521-9244-19ac5a8700c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:10Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a3490f-d84c-4a7d-ae60-c3aabcb79d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a3490f-d84c-4a7d-ae60-c3aabcb79d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0abd7a4-f0ff-4483-965a-ae5d42460c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0abd7a4-f0ff-4483-965a-ae5d42460c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75f0d4a0-e87d-4521-9244-19ac5a8700c4', 'volume_name': 'volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d04765f-b15e-49e2-9b59-251ecd234780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d04765f-b15e-49e2-9b59-251ecd234780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd36d11-916e-4fd0-8bb7-d255154ba477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:10 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume 75f0d4a0-e87d-4521-9244-19ac5a8700c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4', 'volume_size': 1}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:10 devstack sudo[100895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf
Jul 07 22:48:10 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (682014d8-253c-4a71-ba69-b0e0baa67f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c111a9-295b-47ab-81f2-979a65e7812b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c111a9-295b-47ab-81f2-979a65e7812b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2109323937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae495b0-977f-4750-8a38-8774957963e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:10Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07733137-ef72-4896-98b3-bf5504077d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07733137-ef72-4896-98b3-bf5504077d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2bb7f3-d375-4fa1-9874-4205dbcb7b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be2bb7f3-d375-4fa1-9874-4205dbcb7b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae495b0-977f-4750-8a38-8774957963e8', 'volume_name': 'volume-6ae495b0-977f-4750-8a38-8774957963e8', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3333aca9-5b2a-4c17-807c-e82f8b7908f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3333aca9-5b2a-4c17-807c-e82f8b7908f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e314d6-31fe-4135-90f7-52ac26722445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:10 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume 6ae495b0-977f-4750-8a38-8774957963e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae495b0-977f-4750-8a38-8774957963e8', 'volume_size': 1}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:10 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (344d3713-a279-4ab1-b037-9ec895b14d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e929c986-9ff8-41c6-913b-08b40ff71086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf" returned: 0 in 0.816s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.709s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1493742992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b48242-b059-424c-8b1c-3a8e5eb14489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:09Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Creating volume c8b48242-b059-424c-8b1c-3a8e5eb14489 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:11 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e929c986-9ff8-41c6-913b-08b40ff71086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1430094326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6e56ce-4153-4d76-a585-dc8744640c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:11Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:11 devstack sudo[100899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489 1073741824
Jul 07 22:48:11 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9170712-1b46-4022-aaf4-cb8571924b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9170712-1b46-4022-aaf4-cb8571924b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211fce1a-c016-49fa-a985-172e9e6f91ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211fce1a-c016-49fa-a985-172e9e6f91ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d6e56ce-4153-4d76-a585-dc8744640c8c', 'volume_name': 'volume-3d6e56ce-4153-4d76-a585-dc8744640c8c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029447bd-00d9-4342-9673-afbc7f3dd727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (029447bd-00d9-4342-9673-afbc7f3dd727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f610a4-e741-4caa-a886-72bc287beed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:11 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume 3d6e56ce-4153-4d76-a585-dc8744640c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d6e56ce-4153-4d76-a585-dc8744640c8c', 'volume_size': 1}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91355396-76be-465e-b382-d7d5d84fb134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ac9c83-f332-411b-9011-e959cd4df956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:11 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Volume volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf (5dc73aed-63dd-49a0-8730-3d0c26f33acf): created successfully
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ac9c83-f332-411b-9011-e959cd4df956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Flow 'volume_create_manager' (bb351daa-ff71-4311-a772-23f3b03ff7d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b77b06b9-4304-4e10-8f3c-c837162947be tempest-AttachVolumeNegativeTest-1880869948 None] Created volume successfully.
Jul 07 22:48:11 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489 1073741824" returned: 0 in 0.889s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:11 devstack sudo[100905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489
Jul 07 22:48:11 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:12 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489" returned: 0 in 0.683s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.864s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-743244344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a12edd-75fa-4a6b-ba42-9ac00d3cf173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:10Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Creating volume 67a12edd-75fa-4a6b-ba42-9ac00d3cf173 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:12 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:12 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173 1073741824
Jul 07 22:48:12 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845e64d3-73d2-4152-a1f5-bc90025ff663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b48242-b059-424c-8b1c-3a8e5eb14489', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2de47fb-8950-452e-ba0b-5d4e7a6248ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:12 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume volume-c8b48242-b059-424c-8b1c-3a8e5eb14489 (c8b48242-b059-424c-8b1c-3a8e5eb14489): created successfully
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2de47fb-8950-452e-ba0b-5d4e7a6248ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (79a74b9c-a815-44ca-9afa-916844c47298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:12 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c4e000bc-12c8-4678-8082-9fa3ffcce08c tempest-CreateVolumesFromSnapshotTest-979545844 None] Created volume successfully.
Jul 07 22:48:13 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173 1073741824" returned: 0 in 0.885s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:13 devstack sudo[100918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173
Jul 07 22:48:13 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:14 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173" returned: 0 in 0.662s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.056s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1946342762',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75f0d4a0-e87d-4521-9244-19ac5a8700c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:10Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Creating volume 75f0d4a0-e87d-4521-9244-19ac5a8700c4 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:14 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c244e1e-89ba-464b-a804-0855b452ef24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:14 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4 1073741824
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb52b5ff-1655-4fcf-8e05-8a543c4ef9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:14 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:14 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173 (67a12edd-75fa-4a6b-ba42-9ac00d3cf173): created successfully
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb52b5ff-1655-4fcf-8e05-8a543c4ef9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (34b35ed0-1180-4fe5-9ef8-68c9d28791d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:14 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4cb72f40-28ca-4ef9-894d-6f0ffa0757b0 tempest-CreateVolumesFromSnapshotTest-979545844 None] Created volume successfully.
Jul 07 22:48:15 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4 1073741824" returned: 0 in 1.019s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-143bb9be-536b-4118-a5ba-f7ebaf861a3d req-82edce79-bc8b-44ea-8a5b-e8e04cfffbd4 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:15 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4
Jul 07 22:48:15 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:16 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4" returned: 0 in 0.697s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.383s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2109323937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae495b0-977f-4750-8a38-8774957963e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:10Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Creating volume 6ae495b0-977f-4750-8a38-8774957963e8 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:16 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:16 devstack sudo[100948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8 1073741824
Jul 07 22:48:16 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd36d11-916e-4fd0-8bb7-d255154ba477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ed56b5-e737-4e6b-9b06-522cd2f2f940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:16 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4 (75f0d4a0-e87d-4521-9244-19ac5a8700c4): created successfully
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ed56b5-e737-4e6b-9b06-522cd2f2f940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (0c4aa800-eb8d-434a-9266-59cc9f2db855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a449815a-5163-4f45-8001-3dd173455f83 tempest-CreateVolumesFromSnapshotTest-979545844 None] Created volume successfully.
Jul 07 22:48:16 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8 1073741824" returned: 0 in 0.898s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:16 devstack sudo[100955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8
Jul 07 22:48:16 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:17 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8" returned: 0 in 0.653s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.507s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1430094326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6e56ce-4153-4d76-a585-dc8744640c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1676308bdff492b9ce7bb372b10ef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:11Z,use_quota=True,user_id='b9f203464c1d40779b8f33959d924130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Creating volume 3d6e56ce-4153-4d76-a585-dc8744640c8c {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:17 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:17 devstack sudo[100958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c 1073741824
Jul 07 22:48:17 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3e314d6-31fe-4135-90f7-52ac26722445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae495b0-977f-4750-8a38-8774957963e8', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62003c0e-b082-423d-ba81-8a37871a271b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:17 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume volume-6ae495b0-977f-4750-8a38-8774957963e8 (6ae495b0-977f-4750-8a38-8774957963e8): created successfully
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62003c0e-b082-423d-ba81-8a37871a271b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (682014d8-253c-4a71-ba69-b0e0baa67f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:17 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-89f2864e-698c-4740-8409-d76b3a3c41d8 tempest-CreateVolumesFromSnapshotTest-979545844 None] Created volume successfully.
Jul 07 22:48:18 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c 1073741824" returned: 0 in 0.852s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:18 devstack sudo[100963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c
Jul 07 22:48:18 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:19 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c" returned: 0 in 0.694s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-143bb9be-536b-4118-a5ba-f7ebaf861a3d req-82edce79-bc8b-44ea-8a5b-e8e04cfffbd4 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.907s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cebad4c-9ee1-44ad-a1ee-083baf0c587d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-143bb9be-536b-4118-a5ba-f7ebaf861a3d req-82edce79-bc8b-44ea-8a5b-e8e04cfffbd4 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8f610a4-e741-4caa-a886-72bc287beed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6e56ce-4153-4d76-a585-dc8744640c8c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbe566f-b5c1-44ac-9474-c5a74ddc8960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:19 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Volume volume-3d6e56ce-4153-4d76-a585-dc8744640c8c (3d6e56ce-4153-4d76-a585-dc8744640c8c): created successfully
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bbe566f-b5c1-44ac-9474-c5a74ddc8960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Flow 'volume_create_manager' (344d3713-a279-4ab1-b037-9ec895b14d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:19 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4a6a75bd-3c32-4e19-922a-7d758d3a4a29 tempest-CreateVolumesFromSnapshotTest-979545844 None] Created volume successfully.
Jul 07 22:48:19 devstack sudo[101002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf
Jul 07 22:48:19 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-3d6e56ce-4153-4d76-a585-dc8744640c8c-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-3d6e56ce-4153-4d76-a585-dc8744640c8c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-quobyte-3d6e56ce-4153-4d76-a585-dc8744640c8c" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-3d6e56ce-4153-4d76-a585-dc8744640c8c" acquired by "delete_volume" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7a2a99-63dc-447f-8c8f-22707d19e427]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:19 devstack sudo[101004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c
Jul 07 22:48:19 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:20 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-143bb9be-536b-4118-a5ba-f7ebaf861a3d req-82edce79-bc8b-44ea-8a5b-e8e04cfffbd4 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf" returned: 0 in 0.807s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-143bb9be-536b-4118-a5ba-f7ebaf861a3d req-82edce79-bc8b-44ea-8a5b-e8e04cfffbd4 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.827s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-143bb9be-536b-4118-a5ba-f7ebaf861a3d req-82edce79-bc8b-44ea-8a5b-e8e04cfffbd4 tempest-AttachVolumeNegativeTest-1880869948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2be93cea-91f5-4cc4-b133-29eef669e057', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:48:20 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-143bb9be-536b-4118-a5ba-f7ebaf861a3d req-82edce79-bc8b-44ea-8a5b-e8e04cfffbd4 tempest-AttachVolumeNegativeTest-1880869948 None] attachment_update completed successfully.
Jul 07 22:48:20 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c" returned: 0 in 0.842s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:20 devstack sudo[101080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c
Jul 07 22:48:20 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:21 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3d6e56ce-4153-4d76-a585-dc8744640c8c" returned: 0 in 0.681s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-3d6e56ce-4153-4d76-a585-dc8744640c8c" released by "delete_volume" :: held 1.562s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:21 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Created reservations ['686f15cd-97df-438c-84b9-6a4a4ceba0fe', '2f310211-49e9-402e-a1f2-0223d078fac0', 'e58c3245-62bc-4009-af8a-f47be167dcfa', '685017e3-d978-4ca9-bdae-2c5be5cc198e'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:21 devstack sudo[101398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:21 devstack sudo[101398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-6ae495b0-977f-4750-8a38-8774957963e8-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-6ae495b0-977f-4750-8a38-8774957963e8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-quobyte-6ae495b0-977f-4750-8a38-8774957963e8" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-6ae495b0-977f-4750-8a38-8774957963e8" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bc0b7b-3779-46d3-812c-cd0e9509b15b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:22 devstack sudo[101398]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.680s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:22 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Deleted volume successfully.
Jul 07 22:48:22 devstack sudo[101401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8
Jul 07 22:48:22 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f48ea67-0a5a-40ee-8719-083b2beb2169 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-3d6e56ce-4153-4d76-a585-dc8744640c8c-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:22 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8" returned: 0 in 0.846s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:22 devstack sudo[101406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8
Jul 07 22:48:22 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:23 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6ae495b0-977f-4750-8a38-8774957963e8" returned: 0 in 0.690s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-6ae495b0-977f-4750-8a38-8774957963e8" released by "delete_volume" :: held 1.578s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:23 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Created reservations ['3e7d3c75-3ac0-4e15-ac73-417812838055', 'f11c5baa-fb2e-4e55-b007-43917f4d1b46', '92742792-cb79-4d4c-80ff-dc6caad09f88', 'dada6fe6-6041-4699-bc20-83ee326e6c93'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:23 devstack sudo[101410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:23 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-75f0d4a0-e87d-4521-9244-19ac5a8700c4-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-75f0d4a0-e87d-4521-9244-19ac5a8700c4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-quobyte-75f0d4a0-e87d-4521-9244-19ac5a8700c4" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-75f0d4a0-e87d-4521-9244-19ac5a8700c4" acquired by "delete_volume" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:24 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[69939a79-f65a-415d-8066-4b3a8788a04a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:24 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.659s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:24 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:24 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Deleted volume successfully.
Jul 07 22:48:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d4ec7f2b-e077-4892-9952-39e4b9cef1c7 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-6ae495b0-977f-4750-8a38-8774957963e8-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:24 devstack sudo[101413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4
Jul 07 22:48:24 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:25 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4" returned: 0 in 0.820s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:25 devstack sudo[101418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4
Jul 07 22:48:25 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:25 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-75f0d4a0-e87d-4521-9244-19ac5a8700c4" returned: 0 in 0.682s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-75f0d4a0-e87d-4521-9244-19ac5a8700c4" released by "delete_volume" :: held 1.544s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:25 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Created reservations ['8429e8f5-9356-4959-8687-7a03e7154f76', '53909e33-4557-43b2-82cc-aacbff5839ee', '52ba2a70-343e-4d86-a68b-855ddfc8ee77', 'ff809a8b-d82a-4c56-860c-d3006769deb8'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:26 devstack sudo[101421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:26 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-391ca39c-ee8a-4d70-8e62-9adc56622db5 req-c0dd1d20-78ca-4790-b14f-d5a2be4162ef tempest-AttachVolumeNegativeTest-1880869948 None] Terminate volume connection completed successfully.
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-391ca39c-ee8a-4d70-8e62-9adc56622db5 req-c0dd1d20-78ca-4790-b14f-d5a2be4162ef tempest-AttachVolumeNegativeTest-1880869948 None] Deleting attachment 2be93cea-91f5-4cc4-b133-29eef669e057. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-67a12edd-75fa-4a6b-ba42-9ac00d3cf173-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-67a12edd-75fa-4a6b-ba42-9ac00d3cf173-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-quobyte-67a12edd-75fa-4a6b-ba42-9ac00d3cf173" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-67a12edd-75fa-4a6b-ba42-9ac00d3cf173" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44b84ac-ae5e-4f63-80bb-6ab66f4c936e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:26 devstack sudo[101451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173
Jul 07 22:48:26 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:26 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.803s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Deleted volume successfully.
Jul 07 22:48:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cefff122-f52b-4157-945d-c1a0abb82bce tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-75f0d4a0-e87d-4521-9244-19ac5a8700c4-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:27 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173" returned: 0 in 0.916s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:27 devstack sudo[101457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173
Jul 07 22:48:27 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:28 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-67a12edd-75fa-4a6b-ba42-9ac00d3cf173" returned: 0 in 0.742s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-67a12edd-75fa-4a6b-ba42-9ac00d3cf173" released by "delete_volume" :: held 1.703s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Created reservations ['ca6fdf1f-b04f-40db-a020-3f2849b7ee7d', '17cbb369-06ee-466e-b44d-3c0545c1b7e6', '0adbf500-c222-4b76-9374-02197171bfe9', '572abe63-0b9d-4b23-a558-df1353fcccb6'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:28 devstack sudo[101460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:28 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-c8b48242-b059-424c-8b1c-3a8e5eb14489-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-c8b48242-b059-424c-8b1c-3a8e5eb14489-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-quobyte-c8b48242-b059-424c-8b1c-3a8e5eb14489" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-c8b48242-b059-424c-8b1c-3a8e5eb14489" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[758fb008-d20d-4c4a-b3b8-ac2942c17927]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:29 devstack sudo[101462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489
Jul 07 22:48:29 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:29 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.702s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:29 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:29 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Deleted volume successfully.
Jul 07 22:48:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-89e4853a-a57c-4dd7-9715-f4c5494b2630 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-67a12edd-75fa-4a6b-ba42-9ac00d3cf173-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:29 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489" returned: 0 in 0.824s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:29 devstack sudo[101474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489
Jul 07 22:48:29 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:30 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c8b48242-b059-424c-8b1c-3a8e5eb14489" returned: 0 in 0.846s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-c8b48242-b059-424c-8b1c-3a8e5eb14489" released by "delete_volume" :: held 1.724s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:30 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Created reservations ['b1aad47d-b51b-4e2c-970f-c784f217b04f', '08224c0b-a291-4cf7-8378-d0608565c7cd', '6dd3ee9f-ab39-45cf-9243-e4f225c92310', 'af339521-230f-4150-942a-0aa9925f3d24'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:30 devstack sudo[101493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:30 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-427923b7-c03d-4880-85e5-30f163f9769a-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-427923b7-c03d-4880-85e5-30f163f9769a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-quobyte-157ac422-0148-466c-9edb-004f9a35d497" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-157ac422-0148-466c-9edb-004f9a35d497" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-quobyte-427923b7-c03d-4880-85e5-30f163f9769a" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-427923b7-c03d-4880-85e5-30f163f9769a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Deleting offline snapshot 427923b7-c03d-4880-85e5-30f163f9769a of volume 157ac422-0148-466c-9edb-004f9a35d497 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] snapshot_file for this snap is: volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5162c97f-2142-4c02-a5fa-a734ddf63a42]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:31 devstack sudo[101497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a
Jul 07 22:48:31 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:31 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.767s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:31 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Deleted volume successfully.
Jul 07 22:48:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-24956694-1290-44d7-ab2e-51a264a937f2 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-c8b48242-b059-424c-8b1c-3a8e5eb14489-delete_volume" released by "delete_volume" :: held 2.749s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:32 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a" returned: 0 in 0.883s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-157ac422-0148-466c-9edb-004f9a35d497(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:48:32 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daf6771-03e2-49d4-948c-fc961cfd4a84]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:32 devstack sudo[101505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497
Jul 07 22:48:32 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:32 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497" returned: 0 in 0.789s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:32 devstack sudo[101510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a
Jul 07 22:48:32 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:33 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a" returned: 0 in 0.778s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:33 devstack sudo[101516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a
Jul 07 22:48:33 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:34 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497.427923b7-c03d-4880-85e5-30f163f9769a" returned: 0 in 0.722s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-427923b7-c03d-4880-85e5-30f163f9769a" released by "_delete_snapshot" :: held 3.288s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-157ac422-0148-466c-9edb-004f9a35d497" released by "delete_snapshot" :: held 3.311s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:34 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Created reservations ['a66252b7-25f7-4639-ab3c-779245a8e5c9', 'f3076206-392b-4f4a-a651-8942a930f473', '16a5a6db-adc4-4ae8-989d-5bb7e74fdf1a', '5a92263d-f2aa-4931-a943-c1282a46dadc'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:34 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Delete snapshot completed successfully.
Jul 07 22:48:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e3735945-2188-42ab-a919-5c9826fd1e7d tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-427923b7-c03d-4880-85e5-30f163f9769a-delete_snapshot" released by "delete_snapshot" :: held 3.464s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-157ac422-0148-466c-9edb-004f9a35d497-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-157ac422-0148-466c-9edb-004f9a35d497-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "cinder-quobyte-157ac422-0148-466c-9edb-004f9a35d497" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-157ac422-0148-466c-9edb-004f9a35d497" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:35 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[60623c84-19e9-4bdb-aa72-4f01df605429]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:35 devstack sudo[101519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497
Jul 07 22:48:35 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:36 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497" returned: 0 in 0.857s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:36 devstack sudo[101524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497
Jul 07 22:48:36 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "cinder-5dc73aed-63dd-49a0-8730-3d0c26f33acf-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-5dc73aed-63dd-49a0-8730-3d0c26f33acf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "cinder-quobyte-5dc73aed-63dd-49a0-8730-3d0c26f33acf" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-quobyte-5dc73aed-63dd-49a0-8730-3d0c26f33acf" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:36 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b666048-2e67-47f9-8e8e-9d452dc7915d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:36 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-157ac422-0148-466c-9edb-004f9a35d497" returned: 0 in 0.728s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-quobyte-157ac422-0148-466c-9edb-004f9a35d497" released by "delete_volume" :: held 1.650s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:37 devstack sudo[101527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf
Jul 07 22:48:37 devstack sudo[101527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Created reservations ['df3f7124-f6d8-4b49-aafe-22b4aa8c725d', 'ddf167a0-0790-4fb9-a761-28788a4edcb0', 'bbaba93f-8ee7-4809-a985-919c469c7ab3', '1991b3af-16b7-4596-a6fe-126ddb61d4f2'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:37 devstack sudo[101529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:37 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:37 devstack sudo[101527]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf" returned: 0 in 0.836s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:37 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf
Jul 07 22:48:37 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:37 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.741s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Deleted volume successfully.
Jul 07 22:48:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c43e70a6-a3a5-41f4-9a56-5e482068f5c3 tempest-CreateVolumesFromSnapshotTest-979545844 None] Lock "cinder-157ac422-0148-466c-9edb-004f9a35d497-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:38 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5dc73aed-63dd-49a0-8730-3d0c26f33acf" returned: 0 in 0.729s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-quobyte-5dc73aed-63dd-49a0-8730-3d0c26f33acf" released by "delete_volume" :: held 1.606s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:38 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Created reservations ['a855b218-46f1-4a68-87da-17e8253d71a7', '78c87a1e-f5c4-4a2a-9647-84a014f6570a', 'ac1cd885-6995-4a32-87db-d7aca548b8e4', '1ff394ff-beca-4f7b-b660-ae849244669a'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:38 devstack sudo[101538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:38 devstack sudo[101538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "cinder-6fbdb738-c846-4679-bc4e-c41e307fb3e9-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-6fbdb738-c846-4679-bc4e-c41e307fb3e9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "cinder-quobyte-6fbdb738-c846-4679-bc4e-c41e307fb3e9" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-quobyte-6fbdb738-c846-4679-bc4e-c41e307fb3e9" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:39 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6a70d4-bdc6-484c-b653-cd9bf75017d4]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:39 devstack sudo[101538]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.761s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:39 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:39 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Deleted volume successfully.
Jul 07 22:48:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-297a5b2c-1880-49d7-8019-d1ba3eddde99 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-5dc73aed-63dd-49a0-8730-3d0c26f33acf-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:39 devstack sudo[101541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9
Jul 07 22:48:39 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:40 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9" returned: 0 in 0.782s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:40 devstack sudo[101546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9
Jul 07 22:48:40 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:40 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6fbdb738-c846-4679-bc4e-c41e307fb3e9" returned: 0 in 0.715s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-quobyte-6fbdb738-c846-4679-bc4e-c41e307fb3e9" released by "delete_volume" :: held 1.546s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:40 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Created reservations ['02bffacd-54bb-4133-a230-392685fccd60', 'de0f5b0e-02ff-453f-bb0c-5aa557abb589', 'd54641b9-472e-4a4a-8795-b24ce9c67e09', 'bca82318-ac87-4d70-b669-050636a44079'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:41 devstack sudo[101550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:41 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Flow 'volume_create_manager' (3a444013-f036-4270-9018-d093d832aa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ce7c38-7028-4fb8-bb4b-9550687823e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ce7c38-7028-4fb8-bb4b-9550687823e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1800512563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bef2e17-1a12-4195-92c6-4ce419209f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2232acd269044fc88d2b2c27c4686032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:41Z,use_quota=True,user_id='65e25bde096641fba38db87f04196d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbb6b01-44c2-40f5-9aab-6647b82e1762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bbb6b01-44c2-40f5-9aab-6647b82e1762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b5890f-87e6-4ea8-9b26-a448694bcb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b5890f-87e6-4ea8-9b26-a448694bcb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bef2e17-1a12-4195-92c6-4ce419209f2e', 'volume_name': 'volume-5bef2e17-1a12-4195-92c6-4ce419209f2e', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5da81e-c88b-4c05-8e5c-897e92d1b6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5da81e-c88b-4c05-8e5c-897e92d1b6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8f4d74-c4fb-4f43-ac14-b08026ca2ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:41 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Volume 5bef2e17-1a12-4195-92c6-4ce419209f2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bef2e17-1a12-4195-92c6-4ce419209f2e', 'volume_size': 1}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1800512563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bef2e17-1a12-4195-92c6-4ce419209f2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2232acd269044fc88d2b2c27c4686032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:41Z,use_quota=True,user_id='65e25bde096641fba38db87f04196d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Creating volume 5bef2e17-1a12-4195-92c6-4ce419209f2e {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:41 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:41 devstack sudo[101552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e 1073741824
Jul 07 22:48:41 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "cinder-229b19d1-8ea1-4322-a793-a238dda791d9-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-229b19d1-8ea1-4322-a793-a238dda791d9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:41 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.789s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "cinder-quobyte-229b19d1-8ea1-4322-a793-a238dda791d9" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:41 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Deleted volume successfully.
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-quobyte-229b19d1-8ea1-4322-a793-a238dda791d9" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f2446584-0a9a-4c88-9ea1-14f3b8d78158 tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-6fbdb738-c846-4679-bc4e-c41e307fb3e9-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f811b129-7590-4d22-92ec-07443ec2bace]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:41 devstack sudo[101555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9
Jul 07 22:48:41 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:42 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e 1073741824" returned: 0 in 0.944s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:42 devstack sudo[101560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e
Jul 07 22:48:42 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:42 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9" returned: 0 in 0.821s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:42 devstack sudo[101565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9
Jul 07 22:48:42 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:43 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e" returned: 0 in 0.672s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc8f4d74-c4fb-4f43-ac14-b08026ca2ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bef2e17-1a12-4195-92c6-4ce419209f2e', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2f78d0-a2c7-4626-8112-88273ca31142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:43 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Volume volume-5bef2e17-1a12-4195-92c6-4ce419209f2e (5bef2e17-1a12-4195-92c6-4ce419209f2e): created successfully
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2f78d0-a2c7-4626-8112-88273ca31142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Flow 'volume_create_manager' (3a444013-f036-4270-9018-d093d832aa04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3782743f-6860-4ebe-81fe-a8c35304f863 tempest-ProjectReaderTests-141105266 None] Created volume successfully.
Jul 07 22:48:43 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-229b19d1-8ea1-4322-a793-a238dda791d9" returned: 0 in 0.750s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-quobyte-229b19d1-8ea1-4322-a793-a238dda791d9" released by "delete_volume" :: held 1.625s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:43 devstack sudo[101569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:43 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Created reservations ['12565375-fcee-4ad4-ab18-95675af4dec5', '8aef623f-4f2c-40af-8fe4-37a459d7a31e', 'd4fea581-9818-4018-94e5-7740b44dac22', '45efd523-52fb-46d8-ac2e-1e59da8b4580'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Acquiring lock "cinder-5bef2e17-1a12-4195-92c6-4ce419209f2e-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Lock "cinder-5bef2e17-1a12-4195-92c6-4ce419209f2e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:43 devstack sudo[101571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:43 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Acquiring lock "cinder-quobyte-5bef2e17-1a12-4195-92c6-4ce419209f2e" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Lock "cinder-quobyte-5bef2e17-1a12-4195-92c6-4ce419209f2e" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6c9aee-83d1-453a-bea1-965549d571d9]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:43 devstack sudo[101573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e
Jul 07 22:48:43 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:44 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.741s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:48:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:48:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:48:44 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.797s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:44 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Deleted volume successfully.
Jul 07 22:48:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-cae7fd63-d173-4c4e-9ff1-d66f99f391ee tempest-AttachVolumeNegativeTest-1880869948 None] Lock "cinder-229b19d1-8ea1-4322-a793-a238dda791d9-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:44 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e" returned: 0 in 0.916s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:44 devstack sudo[101586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e
Jul 07 22:48:44 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:45 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5bef2e17-1a12-4195-92c6-4ce419209f2e" returned: 0 in 0.704s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Lock "cinder-quobyte-5bef2e17-1a12-4195-92c6-4ce419209f2e" released by "delete_volume" :: held 1.675s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:45 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Created reservations ['85f2fe04-daaf-4f9f-ba49-da86d359f544', 'be7a2b7b-12e5-4376-9f81-62f73f4b2299', '73ce0393-77c2-42b0-9a34-3abd0106e69e', '5f24769d-55a6-4057-adea-09b4902e5cb0'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:45 devstack sudo[101590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:45 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:46 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.681s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:46 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Deleted volume successfully.
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4d2a070b-c205-4973-a6cd-281bc2774c62 tempest-ProjectReaderTests-141105266 None] Lock "cinder-5bef2e17-1a12-4195-92c6-4ce419209f2e-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Flow 'volume_create_manager' (65da5d93-e4e4-46bc-a13e-1c263cb3e6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b57c406-8475-47ca-875e-27a96b44a43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b57c406-8475-47ca-875e-27a96b44a43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575830368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc260f9-471a-4066-a5b3-ffa678e0796b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2232acd269044fc88d2b2c27c4686032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:46Z,use_quota=True,user_id='65e25bde096641fba38db87f04196d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51e4300-6269-4b77-8d99-18f6be866290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51e4300-6269-4b77-8d99-18f6be866290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11357c55-05e9-4ffb-bf24-06312969b02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11357c55-05e9-4ffb-bf24-06312969b02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbc260f9-471a-4066-a5b3-ffa678e0796b', 'volume_name': 'volume-fbc260f9-471a-4066-a5b3-ffa678e0796b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415dfaed-1374-4877-9bf9-93f95b64a85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415dfaed-1374-4877-9bf9-93f95b64a85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dc95c4-2b56-46bf-9baf-f3b0f1e20c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:46 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Volume fbc260f9-471a-4066-a5b3-ffa678e0796b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbc260f9-471a-4066-a5b3-ffa678e0796b', 'volume_size': 1}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575830368',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbc260f9-471a-4066-a5b3-ffa678e0796b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2232acd269044fc88d2b2c27c4686032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:46Z,use_quota=True,user_id='65e25bde096641fba38db87f04196d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Creating volume fbc260f9-471a-4066-a5b3-ffa678e0796b {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:46 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:46 devstack sudo[101594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b 1073741824
Jul 07 22:48:46 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:47 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b 1073741824" returned: 0 in 0.930s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:47 devstack sudo[101600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b
Jul 07 22:48:47 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:48 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b" returned: 0 in 0.713s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8dc95c4-2b56-46bf-9baf-f3b0f1e20c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbc260f9-471a-4066-a5b3-ffa678e0796b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72412a86-d8b8-4ea5-91c7-9e1af59eb047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:48 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Volume volume-fbc260f9-471a-4066-a5b3-ffa678e0796b (fbc260f9-471a-4066-a5b3-ffa678e0796b): created successfully
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72412a86-d8b8-4ea5-91c7-9e1af59eb047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Flow 'volume_create_manager' (65da5d93-e4e4-46bc-a13e-1c263cb3e6db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:48 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-68977983-e11d-4656-a76c-4d134a245ced tempest-ProjectReaderTests-141105266 None] Created volume successfully.
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Acquiring lock "cinder-fbc260f9-471a-4066-a5b3-ffa678e0796b-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Lock "cinder-fbc260f9-471a-4066-a5b3-ffa678e0796b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Acquiring lock "cinder-quobyte-fbc260f9-471a-4066-a5b3-ffa678e0796b" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Lock "cinder-quobyte-fbc260f9-471a-4066-a5b3-ffa678e0796b" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9445ad95-7960-44c5-a258-ad9770d5be02]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:48 devstack sudo[101604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b
Jul 07 22:48:48 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:49 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b" returned: 0 in 0.871s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:49 devstack sudo[101609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b
Jul 07 22:48:49 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:50 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fbc260f9-471a-4066-a5b3-ffa678e0796b" returned: 0 in 0.715s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:50 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Lock "cinder-quobyte-fbc260f9-471a-4066-a5b3-ffa678e0796b" released by "delete_volume" :: held 1.628s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:50 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Created reservations ['92343a5f-1561-4d0e-b1b9-7d61f19c9c51', 'a0c72627-b8d9-4d4e-bd3c-1765817c72f5', 'cc59c0e3-aa7d-449a-aa08-dabe5ed4e2f6', '7e57564c-a1b4-4d16-9e7c-16134a6babbf'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:50 devstack sudo[101612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:50 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:51 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.775s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:51 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Deleted volume successfully.
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-754f610c-3d66-4aee-8922-db8be77241dc tempest-ProjectReaderTests-141105266 None] Lock "cinder-fbc260f9-471a-4066-a5b3-ffa678e0796b-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=86,cinder:UPDATE=122,cinder:INSERT=28,cinder:DELETE=12 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Flow 'volume_create_manager' (8f868ff7-a725-427a-abe0-53842df807f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e20157-1fc2-47ea-9b62-2a9e54131135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44e20157-1fc2-47ea-9b62-2a9e54131135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519978827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38adcb51-8580-4930-8a76-c4b56cff2901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2232acd269044fc88d2b2c27c4686032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:51Z,use_quota=True,user_id='65e25bde096641fba38db87f04196d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ff5d75-dc1e-48a1-b838-c0343a9f7459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ff5d75-dc1e-48a1-b838-c0343a9f7459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2922e8e8-ace5-440d-bd40-f770ac862253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2922e8e8-ace5-440d-bd40-f770ac862253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38adcb51-8580-4930-8a76-c4b56cff2901', 'volume_name': 'volume-38adcb51-8580-4930-8a76-c4b56cff2901', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519e362a-0b62-4db8-823e-dd4042516295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (519e362a-0b62-4db8-823e-dd4042516295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4593e16e-1092-4a16-8042-463c9f88406e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:51 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Volume 38adcb51-8580-4930-8a76-c4b56cff2901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38adcb51-8580-4930-8a76-c4b56cff2901', 'volume_size': 1}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1519978827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38adcb51-8580-4930-8a76-c4b56cff2901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2232acd269044fc88d2b2c27c4686032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:51Z,use_quota=True,user_id='65e25bde096641fba38db87f04196d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Creating volume 38adcb51-8580-4930-8a76-c4b56cff2901 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:51 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:51 devstack sudo[101616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901 1073741824
Jul 07 22:48:51 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=127,cinder:SELECT=93,cinder:INSERT=30,cinder:DELETE=9 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Flow 'volume_create_manager' (b5239c00-41aa-4347-b91d-2f5dff7eb64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab8013f-1c80-4adc-a921-f81f0b392b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab8013f-1c80-4adc-a921-f81f0b392b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1101869579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c54c566e8184523a13aae95ac2f090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:52Z,use_quota=True,user_id='04294151c85c4913b264cde01b9afecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fceee4ff-14af-4383-bf27-76447d3ba31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fceee4ff-14af-4383-bf27-76447d3ba31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242bef13-6886-4779-b4ce-f90e9ef09fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (242bef13-6886-4779-b4ce-f90e9ef09fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38', 'volume_name': 'volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5db5d97-2dc1-4254-bc5a-b258e1ff32ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5db5d97-2dc1-4254-bc5a-b258e1ff32ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d31dcb6-7606-4ff2-9034-a94ac37c6b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:52 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38', 'volume_size': 1}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:52 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901 1073741824" returned: 0 in 0.958s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:52 devstack sudo[101621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901
Jul 07 22:48:52 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:53 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901" returned: 0 in 0.669s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.963s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1101869579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c54c566e8184523a13aae95ac2f090a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:52Z,use_quota=True,user_id='04294151c85c4913b264cde01b9afecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Creating volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:53 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:53 devstack sudo[101624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 1073741824
Jul 07 22:48:53 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4593e16e-1092-4a16-8042-463c9f88406e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38adcb51-8580-4930-8a76-c4b56cff2901', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7413afc-54b7-4ce7-9167-0d3abdb4ae99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:53 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Volume volume-38adcb51-8580-4930-8a76-c4b56cff2901 (38adcb51-8580-4930-8a76-c4b56cff2901): created successfully
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7413afc-54b7-4ce7-9167-0d3abdb4ae99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Flow 'volume_create_manager' (8f868ff7-a725-427a-abe0-53842df807f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:53 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e814d063-e572-4c75-8c87-dffe8c597b1e tempest-ProjectReaderTests-141105266 None] Created volume successfully.
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Acquiring lock "cinder-38adcb51-8580-4930-8a76-c4b56cff2901-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Lock "cinder-38adcb51-8580-4930-8a76-c4b56cff2901-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Acquiring lock "cinder-quobyte-38adcb51-8580-4930-8a76-c4b56cff2901" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Lock "cinder-quobyte-38adcb51-8580-4930-8a76-c4b56cff2901" acquired by "delete_volume" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a9d7f-23b6-4e8a-b194-74b89291182f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:53 devstack sudo[101626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901
Jul 07 22:48:53 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:54 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 1073741824" returned: 0 in 0.988s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:54 devstack sudo[101631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38
Jul 07 22:48:54 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:54 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901" returned: 0 in 0.846s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:54 devstack sudo[101636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901
Jul 07 22:48:54 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:54 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" returned: 0 in 0.664s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d31dcb6-7606-4ff2-9034-a94ac37c6b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f29ac3c-44af-41bb-8e4c-e507fb9c9921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:54 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Volume volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 (ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38): created successfully
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f29ac3c-44af-41bb-8e4c-e507fb9c9921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Flow 'volume_create_manager' (b5239c00-41aa-4347-b91d-2f5dff7eb64e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:54 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-08d074f5-0e69-4ce9-ab77-cea125a70b85 tempest-SnapshotsActionsTest-1909402566 None] Created volume successfully.
Jul 07 22:48:55 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-38adcb51-8580-4930-8a76-c4b56cff2901" returned: 0 in 0.651s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Lock "cinder-quobyte-38adcb51-8580-4930-8a76-c4b56cff2901" released by "delete_volume" :: held 1.548s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Created reservations ['a9fe4db3-d7e9-4530-a928-267864255196', '961dbaf9-91fc-4ac2-88e4-710772b3e4e1', '2f4acef6-9799-407a-a46d-29d9af7edcf1', '00a5328b-5501-41d0-b08a-b851db4df1ab'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:55 devstack sudo[101640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:48:55 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Creating offline snapshot 38452655-9813-47bf-a93a-8bd1c17bceef of volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de98d59-0f43-4907-a2f1-52fea73f29d4]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:55 devstack sudo[101642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38
Jul 07 22:48:55 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:56 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.747s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Deleted volume successfully.
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09810d72-85bf-49b3-8f85-77fc020015c0 tempest-ProjectReaderTests-141105266 None] Lock "cinder-38adcb51-8580-4930-8a76-c4b56cff2901-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:56 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" returned: 0 in 0.877s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:56 devstack sudo[101648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef 1G
Jul 07 22:48:56 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Flow 'volume_create_manager' (f0fdf93b-169f-4e70-9ce0-7d93264b045c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5aea1f6-de54-41d0-841a-fc6369be7285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5aea1f6-de54-41d0-841a-fc6369be7285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603938389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365cd5c5-8310-4c01-864b-e12f4573792a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2232acd269044fc88d2b2c27c4686032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:56Z,use_quota=True,user_id='65e25bde096641fba38db87f04196d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92c7f50-b871-4258-a05a-5742fc8a580d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b92c7f50-b871-4258-a05a-5742fc8a580d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9bc0a0-aea2-473e-a4de-d0f00c418ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9bc0a0-aea2-473e-a4de-d0f00c418ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365cd5c5-8310-4c01-864b-e12f4573792a', 'volume_name': 'volume-365cd5c5-8310-4c01-864b-e12f4573792a', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dfe63f-766d-4712-b5f6-c39999483044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2dfe63f-766d-4712-b5f6-c39999483044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83f322b-f5f6-43c6-838a-d4db1cb19305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:56 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Volume 365cd5c5-8310-4c01-864b-e12f4573792a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365cd5c5-8310-4c01-864b-e12f4573792a', 'volume_size': 1}
Jul 07 22:48:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:57 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef 1G" returned: 0 in 0.823s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:57 devstack sudo[101653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:48:57 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:57 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.775s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:57 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef is being set with open permissions: ugo+rw
Jul 07 22:48:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:58 devstack sudo[101658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:48:58 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:58 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.685s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:58 devstack sudo[101661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.info
Jul 07 22:48:58 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:59 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.info" returned: 0 in 0.672s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:59 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.info is being set with open permissions: ugo+rw
Jul 07 22:48:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:59 devstack sudo[101664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.info
Jul 07 22:48:59 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:00 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.info" returned: 0 in 0.658s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.584s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.555s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-603938389',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365cd5c5-8310-4c01-864b-e12f4573792a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2232acd269044fc88d2b2c27c4686032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:56Z,use_quota=True,user_id='65e25bde096641fba38db87f04196d56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Creating volume 365cd5c5-8310-4c01-864b-e12f4573792a {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:49:00 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:00 devstack sudo[101667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a 1073741824
Jul 07 22:49:00 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-77c86aee-fe42-40cc-9026-695eb522fa20 tempest-SnapshotsActionsTest-1909402566 None] Create snapshot completed successfully
Jul 07 22:49:00 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a 1073741824" returned: 0 in 0.902s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:01 devstack sudo[101674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a
Jul 07 22:49:01 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:01 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a" returned: 0 in 0.649s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.504s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] Creating offline snapshot 834991a2-dbc8-47ea-973b-62636b0f3c7a of volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c83f322b-f5f6-43c6-838a-d4db1cb19305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365cd5c5-8310-4c01-864b-e12f4573792a', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe24852-09c2-4211-9894-ed9f3a28f35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9472d9d-f1fe-443d-99f9-df8e3d553d32]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:01 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Volume volume-365cd5c5-8310-4c01-864b-e12f4573792a (365cd5c5-8310-4c01-864b-e12f4573792a): created successfully
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fe24852-09c2-4211-9894-ed9f3a28f35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Flow 'volume_create_manager' (f0fdf93b-169f-4e70-9ce0-7d93264b045c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-fd3e6539-c75d-4156-8505-3e9fdd2c3394 tempest-ProjectReaderTests-141105266 None] Created volume successfully.
Jul 07 22:49:01 devstack sudo[101677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:01 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:02 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.823s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:02 devstack sudo[101682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a 1G
Jul 07 22:49:02 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Acquiring lock "cinder-365cd5c5-8310-4c01-864b-e12f4573792a-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Lock "cinder-365cd5c5-8310-4c01-864b-e12f4573792a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Acquiring lock "cinder-quobyte-365cd5c5-8310-4c01-864b-e12f4573792a" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Lock "cinder-quobyte-365cd5c5-8310-4c01-864b-e12f4573792a" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdddbb3-58e2-4a52-828f-d0a719be1d03]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:03 devstack sudo[101684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a
Jul 07 22:49:03 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:03 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a 1G" returned: 0 in 0.892s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:03 devstack sudo[101689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a
Jul 07 22:49:03 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:03 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a" returned: 0 in 0.857s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:03 devstack sudo[101694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a
Jul 07 22:49:03 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:04 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a" returned: 0 in 0.738s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:04 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a is being set with open permissions: ugo+rw
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:04 devstack sudo[101699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a
Jul 07 22:49:04 devstack sudo[101699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:04 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-365cd5c5-8310-4c01-864b-e12f4573792a" returned: 0 in 0.713s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Lock "cinder-quobyte-365cd5c5-8310-4c01-864b-e12f4573792a" released by "delete_volume" :: held 1.642s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Created reservations ['6dfcb994-763a-4f39-ad40-aa94f40865d9', '9ac2da43-377a-404d-9c1a-56ccd3dd733d', '02248b2a-934b-4934-b7ea-9428a47857a6', '910e83e5-2056-468d-8efc-d825120055ae'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:04 devstack sudo[101702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:49:04 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:04 devstack sudo[101699]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a" returned: 0 in 0.726s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.289s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-92d30e3d-5aa1-469e-b8c7-d88036b0bbc4 tempest-SnapshotsActionsTest-1909402566 None] Create snapshot completed successfully
Jul 07 22:49:05 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.708s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:05 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Deleted volume successfully.
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9b14dbae-3ea2-4b5c-bba6-a836237f738e tempest-ProjectReaderTests-141105266 None] Lock "cinder-365cd5c5-8310-4c01-864b-e12f4573792a-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-834991a2-dbc8-47ea-973b-62636b0f3c7a-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-834991a2-dbc8-47ea-973b-62636b0f3c7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-quobyte-834991a2-dbc8-47ea-973b-62636b0f3c7a" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-834991a2-dbc8-47ea-973b-62636b0f3c7a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Deleting offline snapshot 834991a2-dbc8-47ea-973b-62636b0f3c7a of volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] snapshot_file for this snap is: volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbfe3df-4fc0-4b84-847e-c1cdb4ad7863]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:05 devstack sudo[101706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a
Jul 07 22:49:05 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:06 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a" returned: 0 in 0.908s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:06 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5b18b1-1c17-493e-9e32-8459160a688a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:06 devstack sudo[101711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:06 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:07 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.908s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:07 devstack sudo[101716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a
Jul 07 22:49:07 devstack sudo[101716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:08 devstack sudo[101716]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a" returned: 0 in 0.778s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:08 devstack sudo[101722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a
Jul 07 22:49:08 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:08 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.834991a2-dbc8-47ea-973b-62636b0f3c7a" returned: 0 in 0.717s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-834991a2-dbc8-47ea-973b-62636b0f3c7a" released by "_delete_snapshot" :: held 3.426s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" released by "delete_snapshot" :: held 3.449s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:09 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Created reservations ['f896fe41-fb71-4ef2-b68a-7123b7a7d952', '89cee054-026b-4120-9475-035544f9ae97', '76dcbbb5-6fbe-470e-8353-85ca7e4c0677', 'ed305218-b50d-4684-b259-21015ea5e786'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:09 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Delete snapshot completed successfully.
Jul 07 22:49:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6e458fa-ee41-40e7-84c4-183f54995f7b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-834991a2-dbc8-47ea-973b-62636b0f3c7a-delete_snapshot" released by "delete_snapshot" :: held 3.594s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] Creating offline snapshot 3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 of volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:49:10 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e91fb3a-e2a4-4988-8ae3-ced98ddaf68b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:10 devstack sudo[101725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:10 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:10 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.810s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:10 devstack sudo[101731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 1G
Jul 07 22:49:10 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:11 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 1G" returned: 0 in 0.894s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:11 devstack sudo[101736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5
Jul 07 22:49:11 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:12 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5" returned: 0 in 0.689s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:12 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 is being set with open permissions: ugo+rw
Jul 07 22:49:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:12 devstack sudo[101741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5
Jul 07 22:49:12 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:13 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5" returned: 0 in 0.640s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.131s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a067cfb0-39ea-4173-98c4-494c4aec4068 tempest-SnapshotsActionsTest-1909402566 None] Create snapshot completed successfully
Jul 07 22:49:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-3684dbbe-505b-4c5e-8adc-136c4cd4b2b5-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-3684dbbe-505b-4c5e-8adc-136c4cd4b2b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-quobyte-3684dbbe-505b-4c5e-8adc-136c4cd4b2b5" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-3684dbbe-505b-4c5e-8adc-136c4cd4b2b5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Deleting offline snapshot 3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 of volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:49:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] snapshot_file for this snap is: volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:49:14 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf622b98-09b4-435d-96f2-970c05472b7f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:14 devstack sudo[101747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5
Jul 07 22:49:14 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:15 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5" returned: 0 in 0.775s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:15 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9ab24b-3cb3-49d5-8cf8-cefd456e9f00]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:15 devstack sudo[101752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:15 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:16 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.817s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:16 devstack sudo[101759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5
Jul 07 22:49:16 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:16 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5" returned: 0 in 0.828s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:16 devstack sudo[101764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5
Jul 07 22:49:16 devstack sudo[101764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:17 devstack sudo[101764]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.3684dbbe-505b-4c5e-8adc-136c4cd4b2b5" returned: 0 in 0.739s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-3684dbbe-505b-4c5e-8adc-136c4cd4b2b5" released by "_delete_snapshot" :: held 3.272s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" released by "delete_snapshot" :: held 3.297s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:17 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Created reservations ['00bae469-73aa-48c4-bb07-e20f336dea76', 'e7518d5e-f259-46d6-91e4-0a3f57266017', '33a6d19e-9843-41e2-a555-41ecd56aef0e', '2a13d484-31e4-4bc3-b1c6-c7b1c2c8d52c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:17 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Delete snapshot completed successfully.
Jul 07 22:49:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50f123e5-98d4-4229-a0d7-ae6f7fdcbb4b tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-3684dbbe-505b-4c5e-8adc-136c4cd4b2b5-delete_snapshot" released by "delete_snapshot" :: held 3.453s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] Creating offline snapshot 938e32c0-6072-49c4-b359-02186d858938 of volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:49:18 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed3d07c-bd35-4574-9817-16053ae2b121]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:19 devstack sudo[101767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:19 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:19 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.810s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:19 devstack sudo[101808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938 1G
Jul 07 22:49:19 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:20 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938 1G" returned: 0 in 0.847s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:20 devstack sudo[101814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938
Jul 07 22:49:20 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:21 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938" returned: 0 in 0.780s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:21 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938 is being set with open permissions: ugo+rw
Jul 07 22:49:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:21 devstack sudo[101819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938
Jul 07 22:49:21 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:22 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938" returned: 0 in 0.715s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.247s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:22 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-739b794d-ad55-453f-a6ac-3dd8787b0bf2 tempest-SnapshotsActionsTest-1909402566 None] Create snapshot completed successfully
Jul 07 22:49:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-938e32c0-6072-49c4-b359-02186d858938-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-938e32c0-6072-49c4-b359-02186d858938-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-quobyte-938e32c0-6072-49c4-b359-02186d858938" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-938e32c0-6072-49c4-b359-02186d858938" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Deleting offline snapshot 938e32c0-6072-49c4-b359-02186d858938 of volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:49:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] snapshot_file for this snap is: volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:49:23 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b76824d-c0f4-4ccc-a221-8234896c4ac4]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:23 devstack sudo[101822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938
Jul 07 22:49:23 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:24 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938" returned: 0 in 0.799s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:24 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4139ca-2e8e-4392-abb7-ebfc1fe1602a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:24 devstack sudo[101828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:24 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:24 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.773s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:24 devstack sudo[101833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938
Jul 07 22:49:24 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:25 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938" returned: 0 in 0.817s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:25 devstack sudo[101838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938
Jul 07 22:49:25 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:26 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.938e32c0-6072-49c4-b359-02186d858938" returned: 0 in 0.669s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-938e32c0-6072-49c4-b359-02186d858938" released by "_delete_snapshot" :: held 3.151s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" released by "delete_snapshot" :: held 3.175s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:26 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Created reservations ['9068add5-cbae-4858-949e-aca3911ffc43', '76688235-b8cc-44bc-8f38-beda69184121', '7587589f-8b68-4096-838e-50b75ba99b75', '3dc0a382-6e5f-4b3b-bc30-4c78c1bd6851'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Delete snapshot completed successfully.
Jul 07 22:49:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2040a833-00c4-4c04-a3f1-57b34d806c61 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-938e32c0-6072-49c4-b359-02186d858938-delete_snapshot" released by "delete_snapshot" :: held 3.312s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] Creating offline snapshot 2b4476ab-cc13-4d67-8367-07fc02d43bea of volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:49:27 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a568978-0ea5-49e9-ad09-1ca30acd7d6d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:27 devstack sudo[101841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:27 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:28 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.832s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:28 devstack sudo[101847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea 1G
Jul 07 22:49:28 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:29 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea 1G" returned: 0 in 0.901s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:29 devstack sudo[101853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea
Jul 07 22:49:29 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:30 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea" returned: 0 in 0.734s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:30 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea is being set with open permissions: ugo+rw
Jul 07 22:49:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:30 devstack sudo[101858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea
Jul 07 22:49:30 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:30 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea" returned: 0 in 0.718s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.293s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:30 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4637c9bc-23af-4ed7-805e-372744c3681a tempest-SnapshotsActionsTest-1909402566 None] Create snapshot completed successfully
Jul 07 22:49:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-2b4476ab-cc13-4d67-8367-07fc02d43bea-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-2b4476ab-cc13-4d67-8367-07fc02d43bea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Acquiring lock "cinder-quobyte-2b4476ab-cc13-4d67-8367-07fc02d43bea" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-2b4476ab-cc13-4d67-8367-07fc02d43bea" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Deleting offline snapshot 2b4476ab-cc13-4d67-8367-07fc02d43bea of volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:49:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] snapshot_file for this snap is: volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:49:32 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9cf44a-d633-4019-87b5-5861f091541a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:32 devstack sudo[101862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea
Jul 07 22:49:32 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:32 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea" returned: 0 in 0.825s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:32 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[911a85c1-f1c9-4c8b-9869-1e37793a4bca]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:33 devstack sudo[101867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:33 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:33 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.748s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:33 devstack sudo[101872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea
Jul 07 22:49:33 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:34 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea" returned: 0 in 0.783s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:34 devstack sudo[101877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea
Jul 07 22:49:34 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:35 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.2b4476ab-cc13-4d67-8367-07fc02d43bea" returned: 0 in 0.677s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-2b4476ab-cc13-4d67-8367-07fc02d43bea" released by "_delete_snapshot" :: held 3.128s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" released by "delete_snapshot" :: held 3.153s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:35 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Created reservations ['652eb146-8a9a-4c90-9aa4-9a7e4a5c08b7', 'de9d5684-3357-43aa-b0ae-f3597af484c7', '5cf98b02-fe9b-474f-8d55-836ea2c49f6f', '809414d3-f172-4120-b8aa-863d1012e8e5'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:35 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Delete snapshot completed successfully.
Jul 07 22:49:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1cedb98b-5578-40ad-81bb-28477742cec6 tempest-SnapshotsActionsTest-285243788 None] Lock "cinder-2b4476ab-cc13-4d67-8367-07fc02d43bea-delete_snapshot" released by "delete_snapshot" :: held 3.331s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "cinder-38452655-9813-47bf-a93a-8bd1c17bceef-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Lock "cinder-38452655-9813-47bf-a93a-8bd1c17bceef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "cinder-quobyte-38452655-9813-47bf-a93a-8bd1c17bceef" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Lock "cinder-quobyte-38452655-9813-47bf-a93a-8bd1c17bceef" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Deleting offline snapshot 38452655-9813-47bf-a93a-8bd1c17bceef of volume ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:49:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] snapshot_file for this snap is: volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:49:36 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[685adc03-5176-4261-b397-39e088e60c1c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:36 devstack sudo[101880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:36 devstack sudo[101880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:37 devstack sudo[101880]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.825s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:37 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43c988e-7f28-4530-9068-c3c11309556e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:37 devstack sudo[101886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38
Jul 07 22:49:37 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:38 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" returned: 0 in 0.816s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:38 devstack sudo[101891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:38 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:39 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.775s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:39 devstack sudo[101896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef
Jul 07 22:49:39 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:39 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38.38452655-9813-47bf-a93a-8bd1c17bceef" returned: 0 in 0.675s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Lock "cinder-quobyte-38452655-9813-47bf-a93a-8bd1c17bceef" released by "_delete_snapshot" :: held 3.214s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" released by "delete_snapshot" :: held 3.237s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:39 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Created reservations ['08a5e9e3-5cd3-4731-a3ff-9f8f81da2192', 'da745cd9-c24c-4465-9e5d-830ab7b0ab3b', 'fa155331-3447-42bc-8f19-0daad5af82b5', '6e2591f8-54f1-458b-9855-9e5eb31fe065'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:39 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Delete snapshot completed successfully.
Jul 07 22:49:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ecaa0e6-30ab-4b73-aea2-39aead974541 tempest-SnapshotsActionsTest-1909402566 None] Lock "cinder-38452655-9813-47bf-a93a-8bd1c17bceef-delete_snapshot" released by "delete_snapshot" :: held 3.386s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "cinder-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Lock "cinder-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" acquired by "delete_volume" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:41 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4820a1b5-f826-47a6-bdbd-bd4bfba3eccf]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:41 devstack sudo[101900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38
Jul 07 22:49:41 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:41 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" returned: 0 in 0.762s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:41 devstack sudo[101905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38
Jul 07 22:49:41 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:42 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" returned: 0 in 0.663s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Lock "cinder-quobyte-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38" released by "delete_volume" :: held 1.486s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:42 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Created reservations ['04b502b3-11c2-410e-9b7b-74d0b0fb59f8', '169a4a19-fdab-48c6-be4c-dca8fcdde28e', '088b5a31-1776-40c6-b1e7-f4188abb2245', '4a18e572-7ca0-4b95-9c93-8cbeed090a5e'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:42 devstack sudo[101908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:49:42 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:43 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.681s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:43 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Deleted volume successfully.
Jul 07 22:49:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-82e52450-8f03-4863-be85-bf6440f7fe15 tempest-SnapshotsActionsTest-1909402566 None] Lock "cinder-ff566ce1-3b2e-4d2b-8e28-4ac65ffd6d38-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:49:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:43 devstack sudo[101911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:49:43 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:44 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.718s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:49:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:49:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Flow 'volume_create_manager' (1e84760e-af99-44ac-9917-ab4bfe0cd40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691c39c3-df69-4a56-a0c8-31662f632ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (691c39c3-df69-4a56-a0c8-31662f632ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1827945241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45e6574-0c8b-43e0-95ca-0a6c09c55556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c431e73c4548b2baff9ae8e149682e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:48Z,use_quota=True,user_id='0fe3d580a9fe4801950101b7ab109f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfad95d-6745-4456-add1-ce9c1f252fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bfad95d-6745-4456-add1-ce9c1f252fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21643dee-fbd8-46a0-9787-334115bdd996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21643dee-fbd8-46a0-9787-334115bdd996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd45e6574-0c8b-43e0-95ca-0a6c09c55556', 'volume_name': 'volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999311cf-782c-47a8-80d1-948c608e0aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999311cf-782c-47a8-80d1-948c608e0aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7f40fd-a271-4774-984b-e874befe13dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:48 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Volume d45e6574-0c8b-43e0-95ca-0a6c09c55556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556', 'volume_size': 1}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1827945241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45e6574-0c8b-43e0-95ca-0a6c09c55556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4c431e73c4548b2baff9ae8e149682e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:48Z,use_quota=True,user_id='0fe3d580a9fe4801950101b7ab109f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Creating volume d45e6574-0c8b-43e0-95ca-0a6c09c55556 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:49:48 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:49:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:48 devstack sudo[101921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556 1073741824
Jul 07 22:49:48 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:49 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556 1073741824" returned: 0 in 0.943s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:49 devstack sudo[101926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556
Jul 07 22:49:49 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:50 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556" returned: 0 in 0.753s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7f40fd-a271-4774-984b-e874befe13dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8ff3d4-d34d-4c63-bd31-abba08776ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:50 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Volume volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556 (d45e6574-0c8b-43e0-95ca-0a6c09c55556): created successfully
Jul 07 22:49:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b8ff3d4-d34d-4c63-bd31-abba08776ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Flow 'volume_create_manager' (1e84760e-af99-44ac-9917-ab4bfe0cd40d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:50 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b33a130d-2b4f-4f91-821e-f88ee22ea599 tempest-VolumeQuotasNegativeTestJSON-826622971 None] Created volume successfully.
Jul 07 22:49:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Acquiring lock "cinder-d45e6574-0c8b-43e0-95ca-0a6c09c55556-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Lock "cinder-d45e6574-0c8b-43e0-95ca-0a6c09c55556-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:52 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=58,cinder:INSERT=18,cinder:UPDATE=68,cinder:DELETE=6 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:49:52 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=62,cinder:UPDATE=70,cinder:DELETE=6,cinder:INSERT=19 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:49:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Acquiring lock "cinder-quobyte-d45e6574-0c8b-43e0-95ca-0a6c09c55556" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Lock "cinder-quobyte-d45e6574-0c8b-43e0-95ca-0a6c09c55556" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:52 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b8c027-dbe5-4219-85a4-66abe3ad2a68]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:52 devstack sudo[101930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556
Jul 07 22:49:52 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:53 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556" returned: 0 in 0.796s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:53 devstack sudo[101935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556
Jul 07 22:49:53 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:54 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d45e6574-0c8b-43e0-95ca-0a6c09c55556" returned: 0 in 0.694s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Lock "cinder-quobyte-d45e6574-0c8b-43e0-95ca-0a6c09c55556" released by "delete_volume" :: held 1.541s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Created reservations ['4240c939-9441-42d4-8f3b-fe449fdff4da', '6bbeefb5-b6a6-4cee-90bd-2ad7a0e15f6d', '2488443b-7f84-414e-b627-8ac6bb9fd096', '8cc471fb-dcac-45ca-9f8e-0dce713ae6c8'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:54 devstack sudo[101938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:49:54 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:54 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.647s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:54 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:54 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Deleted volume successfully.
Jul 07 22:49:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d42660ca-0b38-4e53-952e-c6ec32db8f9e tempest-VolumeQuotasNegativeTestJSON-826622971 None] Lock "cinder-d45e6574-0c8b-43e0-95ca-0a6c09c55556-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:04 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:50:04 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Flow 'volume_create_manager' (df5307f1-a538-40e8-9a4a-49c04d31dde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dda5db0-352a-496e-99e5-ffc3bd518ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dda5db0-352a-496e-99e5-ffc3bd518ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-829356941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221afbff-cc2d-4f2d-870d-d33bb6562138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e00c540f1c4b59ba638ca1059ec130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:11Z,use_quota=True,user_id='9d5d3850ccef42fcb834492b5800f709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5143cb-b6d9-441e-b3e9-c1e576e14c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5143cb-b6d9-441e-b3e9-c1e576e14c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6ae504-a525-4da3-8ea0-e181ad9c1e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be6ae504-a525-4da3-8ea0-e181ad9c1e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '221afbff-cc2d-4f2d-870d-d33bb6562138', 'volume_name': 'volume-221afbff-cc2d-4f2d-870d-d33bb6562138', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f0b19f-3791-4ba4-aff9-31af2fe5fcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f0b19f-3791-4ba4-aff9-31af2fe5fcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9114483e-7ea4-400f-a10a-62f73d87d56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:11 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Volume 221afbff-cc2d-4f2d-870d-d33bb6562138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-221afbff-cc2d-4f2d-870d-d33bb6562138', 'volume_size': 1}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-829356941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221afbff-cc2d-4f2d-870d-d33bb6562138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e00c540f1c4b59ba638ca1059ec130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:11Z,use_quota=True,user_id='9d5d3850ccef42fcb834492b5800f709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Creating volume 221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:11 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:50:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:11 devstack sudo[101945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138 1073741824
Jul 07 22:50:11 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:12 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138 1073741824" returned: 0 in 0.896s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:12 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138
Jul 07 22:50:12 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:13 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138" returned: 0 in 0.690s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9114483e-7ea4-400f-a10a-62f73d87d56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-221afbff-cc2d-4f2d-870d-d33bb6562138', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59c68f9-a28d-4099-9266-1b6330643fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:13 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Volume volume-221afbff-cc2d-4f2d-870d-d33bb6562138 (221afbff-cc2d-4f2d-870d-d33bb6562138): created successfully
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c59c68f9-a28d-4099-9266-1b6330643fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Flow 'volume_create_manager' (df5307f1-a538-40e8-9a4a-49c04d31dde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0d0765f3-7e73-442b-9450-9fe7da158ce9 tempest-VolumesDeleteCascade-630047316 None] Created volume successfully.
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Creating offline snapshot 03e6e201-3bb0-426f-b865-6278b5474fc4 of volume 221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a988cd11-2604-4ace-9ead-feb47e6eb926]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:13 devstack sudo[101955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138
Jul 07 22:50:13 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:14 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138" returned: 0 in 0.798s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:14 devstack sudo[101960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 1G
Jul 07 22:50:14 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:15 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 1G" returned: 0 in 0.776s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221afbff-cc2d-4f2d-870d-d33bb6562138 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:15 devstack sudo[101966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221afbff-cc2d-4f2d-870d-d33bb6562138 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4
Jul 07 22:50:15 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:15 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221afbff-cc2d-4f2d-870d-d33bb6562138 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4" returned: 0 in 0.685s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:15 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 is being set with open permissions: ugo+rw
Jul 07 22:50:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:15 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4
Jul 07 22:50:15 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:16 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4" returned: 0 in 0.695s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:16 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.info
Jul 07 22:50:16 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:17 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.info" returned: 0 in 0.671s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:17 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.info is being set with open permissions: ugo+rw
Jul 07 22:50:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:17 devstack sudo[101982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.info
Jul 07 22:50:17 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:18 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.info" returned: 0 in 0.635s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.347s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:18 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-326c3632-133d-4c58-a257-6a6d6f95e3c7 tempest-VolumesDeleteCascade-630047316 None] Create snapshot completed successfully
Jul 07 22:50:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] Creating offline snapshot e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 of volume 221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:50:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69d8fc9-681e-41bc-8036-653a9550462c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:19 devstack sudo[101985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4
Jul 07 22:50:19 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:19 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4" returned: 0 in 0.851s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221afbff-cc2d-4f2d-870d-d33bb6562138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:50:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:20 devstack sudo[102026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 1G
Jul 07 22:50:20 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:20 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 1G" returned: 0 in 0.827s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:20 devstack sudo[102033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2
Jul 07 22:50:20 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:21 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2" returned: 0 in 0.739s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:21 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 is being set with open permissions: ugo+rw
Jul 07 22:50:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:21 devstack sudo[102038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2
Jul 07 22:50:21 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:22 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2" returned: 0 in 0.684s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.220s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:22 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5fb24662-f3b6-4ba2-958d-45926bfe7446 tempest-VolumesDeleteCascade-630047316 None] Create snapshot completed successfully
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-221afbff-cc2d-4f2d-870d-d33bb6562138-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-221afbff-cc2d-4f2d-870d-d33bb6562138-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Performing cascade delete. {{(pid=88077) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-03e6e201-3bb0-426f-b865-6278b5474fc4-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-03e6e201-3bb0-426f-b865-6278b5474fc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-221afbff-cc2d-4f2d-870d-d33bb6562138" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-221afbff-cc2d-4f2d-870d-d33bb6562138" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-03e6e201-3bb0-426f-b865-6278b5474fc4" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-03e6e201-3bb0-426f-b865-6278b5474fc4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Deleting offline snapshot 03e6e201-3bb0-426f-b865-6278b5474fc4 of volume 221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] snapshot_file for this snap is: volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4958dae7-fdd2-4127-9192-912ddee0ab81]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:23 devstack sudo[102041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4
Jul 07 22:50:23 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:24 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4" returned: 0 in 0.774s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221afbff-cc2d-4f2d-870d-d33bb6562138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:50:24 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1701670d-7027-4432-a920-11abb25c72cf]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:24 devstack sudo[102046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138
Jul 07 22:50:24 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:25 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138" returned: 0 in 0.825s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[555951f8-ffc6-4b6a-940f-aed2568502b8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:25 devstack sudo[102052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2
Jul 07 22:50:25 devstack sudo[102052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:26 devstack sudo[102052]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2" returned: 0 in 0.835s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221afbff-cc2d-4f2d-870d-d33bb6562138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:50:26 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b503f85a-2f3d-4fb8-a93b-e27ec1a4af84]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:26 devstack sudo[102058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4
Jul 07 22:50:26 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:26 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4" returned: 0 in 0.821s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221afbff-cc2d-4f2d-870d-d33bb6562138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:50:26 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16bda8b-304c-46c0-b325-e62f19bfee2b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:26 devstack sudo[102063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138
Jul 07 22:50:26 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:27 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138" returned: 0 in 0.802s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:27 devstack sudo[102068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4
Jul 07 22:50:27 devstack sudo[102068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:28 devstack sudo[102068]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4" returned: 0 in 0.718s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:28 devstack sudo[102073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4
Jul 07 22:50:28 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:29 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.03e6e201-3bb0-426f-b865-6278b5474fc4" returned: 0 in 0.685s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221afbff-cc2d-4f2d-870d-d33bb6562138 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 -F qcow2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:29 devstack sudo[102076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221afbff-cc2d-4f2d-870d-d33bb6562138 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 -F qcow2
Jul 07 22:50:29 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:29 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221afbff-cc2d-4f2d-870d-d33bb6562138 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 -F qcow2" returned: 0 in 0.713s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-03e6e201-3bb0-426f-b865-6278b5474fc4" released by "_delete_snapshot" :: held 6.356s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-221afbff-cc2d-4f2d-870d-d33bb6562138" released by "delete_snapshot" :: held 6.379s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Created reservations ['863415d6-7e64-4e53-bb3f-9e9f5760478e', '2962e4c0-fc5c-4ab8-9e28-70085faa7c02', '1a3e49c6-ae4d-4928-a952-7b67631f371f', '9b1d151e-9c06-44d9-8cad-d40c2a1d3154'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:29 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Delete snapshot completed successfully.
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-03e6e201-3bb0-426f-b865-6278b5474fc4-delete_snapshot" released by "delete_snapshot" :: held 6.542s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-e1f0500a-f70d-46cb-8278-0e8f1f7d50f2-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-e1f0500a-f70d-46cb-8278-0e8f1f7d50f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-221afbff-cc2d-4f2d-870d-d33bb6562138" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-221afbff-cc2d-4f2d-870d-d33bb6562138" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-e1f0500a-f70d-46cb-8278-0e8f1f7d50f2" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-e1f0500a-f70d-46cb-8278-0e8f1f7d50f2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Deleting offline snapshot e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 of volume 221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:50:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] snapshot_file for this snap is: volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:50:30 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[914a60cb-5a0d-49fe-838b-12db0397cc7c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:30 devstack sudo[102081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2
Jul 07 22:50:30 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:30 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2" returned: 0 in 0.800s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221afbff-cc2d-4f2d-870d-d33bb6562138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:50:30 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9bf89c-984c-429d-9551-9569542e4142]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:30 devstack sudo[102087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138
Jul 07 22:50:30 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:31 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138" returned: 0 in 0.769s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:31 devstack sudo[102092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2
Jul 07 22:50:31 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:32 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2" returned: 0 in 0.756s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:32 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2
Jul 07 22:50:32 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:33 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138.e1f0500a-f70d-46cb-8278-0e8f1f7d50f2" returned: 0 in 0.688s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-e1f0500a-f70d-46cb-8278-0e8f1f7d50f2" released by "_delete_snapshot" :: held 3.109s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-221afbff-cc2d-4f2d-870d-d33bb6562138" released by "delete_snapshot" :: held 3.130s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:33 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Created reservations ['d64848ee-8d45-4542-ab1e-6572ed704710', '7961e904-c4d7-4436-b2d6-4d6f20459839', '42ff1f22-9c98-4ee3-999e-e9df7441efba', '5bb743a7-bf68-4e95-867d-1352d02269c3'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Delete snapshot completed successfully.
Jul 07 22:50:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-e1f0500a-f70d-46cb-8278-0e8f1f7d50f2-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Snapshots deleted, issuing volume delete {{(pid=88077) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 07 22:50:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-221afbff-cc2d-4f2d-870d-d33bb6562138" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-221afbff-cc2d-4f2d-870d-d33bb6562138" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:33 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9973c973-5499-48e7-b6ee-0b813e136238]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:33 devstack sudo[102100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138
Jul 07 22:50:33 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:34 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138" returned: 0 in 0.811s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:34 devstack sudo[102106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138
Jul 07 22:50:34 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:34 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-221afbff-cc2d-4f2d-870d-d33bb6562138" returned: 0 in 0.723s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-221afbff-cc2d-4f2d-870d-d33bb6562138" released by "delete_volume" :: held 1.603s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:34 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Created reservations ['47ccfcf2-27ab-4707-b916-0dfd044e69a6', '1ca8059e-21b7-41a6-8589-ec0147298b32', '58b56bad-68c8-4bd3-9f97-c9b0ed1fd157', '420c1d0d-b831-4a40-a82b-535dca35a2e9'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:35 devstack sudo[102109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:50:35 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:35 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.727s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:35 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Deleted volume successfully.
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9e0edc10-1a26-4bf8-aeaa-6a94fba5136f tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-221afbff-cc2d-4f2d-870d-d33bb6562138-delete_volume" released by "delete_volume" :: held 12.435s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Flow 'volume_create_manager' (6f1e8a1a-6dba-4fca-9079-bce74f0c2eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11571ac-cb83-458e-b4b5-798460fce513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11571ac-cb83-458e-b4b5-798460fce513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1873984960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97ac6c0-247e-411b-9617-fcb723c100ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e00c540f1c4b59ba638ca1059ec130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:36Z,use_quota=True,user_id='9d5d3850ccef42fcb834492b5800f709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8235eaa-309a-44c3-acc5-4a38b3248a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8235eaa-309a-44c3-acc5-4a38b3248a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76b963a-d3bc-4a0c-a12c-45b1d2f4cedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e76b963a-d3bc-4a0c-a12c-45b1d2f4cedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97ac6c0-247e-411b-9617-fcb723c100ad', 'volume_name': 'volume-c97ac6c0-247e-411b-9617-fcb723c100ad', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad590951-7d6f-484b-b7cf-717b5e22bfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad590951-7d6f-484b-b7cf-717b5e22bfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e1fae9-889d-4b76-ba72-a819c6f41c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:35 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Volume c97ac6c0-247e-411b-9617-fcb723c100ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97ac6c0-247e-411b-9617-fcb723c100ad', 'volume_size': 1}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1873984960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97ac6c0-247e-411b-9617-fcb723c100ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e00c540f1c4b59ba638ca1059ec130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:36Z,use_quota=True,user_id='9d5d3850ccef42fcb834492b5800f709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Creating volume c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:35 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:50:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:36 devstack sudo[102112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad 1073741824
Jul 07 22:50:36 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:36 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad 1073741824" returned: 0 in 0.869s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:36 devstack sudo[102117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad
Jul 07 22:50:36 devstack sudo[102117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:37 devstack sudo[102117]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad" returned: 0 in 0.675s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:50:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e1fae9-889d-4b76-ba72-a819c6f41c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97ac6c0-247e-411b-9617-fcb723c100ad', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203ea853-7a05-4ab6-b035-b19d5f0f69f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:37 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Volume volume-c97ac6c0-247e-411b-9617-fcb723c100ad (c97ac6c0-247e-411b-9617-fcb723c100ad): created successfully
Jul 07 22:50:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203ea853-7a05-4ab6-b035-b19d5f0f69f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Flow 'volume_create_manager' (6f1e8a1a-6dba-4fca-9079-bce74f0c2eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4ab7eb79-70af-4791-9612-fe1d1567d802 tempest-VolumesDeleteCascade-630047316 None] Created volume successfully.
Jul 07 22:50:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Creating offline snapshot ebee526e-b4c9-4c65-870f-762d184c63c5 of volume c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:50:38 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6cef1f-0fd4-4ed3-9014-90505cb3af30]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:38 devstack sudo[102120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad
Jul 07 22:50:38 devstack sudo[102120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:39 devstack sudo[102120]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad" returned: 0 in 0.842s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:39 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 1G
Jul 07 22:50:39 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:40 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 1G" returned: 0 in 1.012s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97ac6c0-247e-411b-9617-fcb723c100ad -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:40 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97ac6c0-247e-411b-9617-fcb723c100ad -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5
Jul 07 22:50:40 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:40 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97ac6c0-247e-411b-9617-fcb723c100ad -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5" returned: 0 in 0.747s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:40 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 is being set with open permissions: ugo+rw
Jul 07 22:50:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:40 devstack sudo[102136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5
Jul 07 22:50:40 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:41 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5" returned: 0 in 0.773s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:41 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.info
Jul 07 22:50:41 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:42 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.info" returned: 0 in 0.671s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:42 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.info is being set with open permissions: ugo+rw
Jul 07 22:50:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:42 devstack sudo[102142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.info
Jul 07 22:50:42 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:42 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.info" returned: 0 in 0.665s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.799s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:42 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f65f8a26-2143-4fea-82ec-fc4f087a5f39 tempest-VolumesDeleteCascade-630047316 None] Create snapshot completed successfully
Jul 07 22:50:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:50:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:43 devstack sudo[102145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:50:43 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:43 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Flow 'volume_create_manager' (aa1a5da5-3566-4ce2-8dd3-572049be8df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51f478b-f4f2-4a45-ad28-525881eab453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f51f478b-f4f2-4a45-ad28-525881eab453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-197797746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7115db99-f046-4e9a-8340-0ef6998ec3e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63e00c540f1c4b59ba638ca1059ec130',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ebee526e-b4c9-4c65-870f-762d184c63c5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:44Z,use_quota=True,user_id='9d5d3850ccef42fcb834492b5800f709',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19ff153-4769-4286-8bb3-19ded2e53527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19ff153-4769-4286-8bb3-19ded2e53527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7290a145-c3b0-4474-be86-2047c082fc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7290a145-c3b0-4474-be86-2047c082fc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7115db99-f046-4e9a-8340-0ef6998ec3e8', 'volume_name': 'volume-7115db99-f046-4e9a-8340-0ef6998ec3e8', 'volume_size': 1, 'snapshot_id': 'ebee526e-b4c9-4c65-870f-762d184c63c5'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db14bc2f-19c2-46e2-bec6-4240feb5dd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db14bc2f-19c2-46e2-bec6-4240feb5dd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1044307a-0f7f-4610-aa3d-94bd7af50433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:44 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Volume 7115db99-f046-4e9a-8340-0ef6998ec3e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7115db99-f046-4e9a-8340-0ef6998ec3e8', 'volume_size': 1, 'snapshot_id': 'ebee526e-b4c9-4c65-870f-762d184c63c5'}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-ebee526e-b4c9-4c65-870f-762d184c63c5-7115db99-f046-4e9a-8340-0ef6998ec3e8" by "_create_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-ebee526e-b4c9-4c65-870f-762d184c63c5-7115db99-f046-4e9a-8340-0ef6998ec3e8" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Creating volume 7115db99-f046-4e9a-8340-0ef6998ec3e8 from snapshot ebee526e-b4c9-4c65-870f-762d184c63c5 {{(pid=88077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-7115db99-f046-4e9a-8340-0ef6998ec3e8" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-7115db99-f046-4e9a-8340-0ef6998ec3e8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] snapshot: ebee526e-b4c9-4c65-870f-762d184c63c5, volume: 7115db99-f046-4e9a-8340-0ef6998ec3e8,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:50:44 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.741s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e20193-fbdc-4cd0-8ded-872153ba9677]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:44 devstack sudo[102148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5
Jul 07 22:50:44 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:45 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5" returned: 0 in 0.788s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97ac6c0-247e-411b-9617-fcb723c100ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:50:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:50:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:50:45 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[debc7892-2047-43d5-afc4-6d087518b244]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:45 devstack sudo[102159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad
Jul 07 22:50:45 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:45 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad" returned: 0 in 0.789s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:45 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8 not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:50:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:45 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8
Jul 07 22:50:45 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:50 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8" returned: 0 in 4.507s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:50 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e104d8-4ba3-4e33-b393-983de563f3d2]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:50 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad
Jul 07 22:50:50 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:51 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad" returned: 0 in 0.996s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:51 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:50:51 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Converted 1024.00 MB image at 227.15 MB/s
Jul 07 22:50:51 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8 is being set with open permissions: ugo+rw
Jul 07 22:50:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:51 devstack sudo[102183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8
Jul 07 22:50:51 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:52 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8" returned: 0 in 0.682s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-7115db99-f046-4e9a-8340-0ef6998ec3e8" released by "_copy_volume_from_snapshot" :: held 7.869s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-ebee526e-b4c9-4c65-870f-762d184c63c5-7115db99-f046-4e9a-8340-0ef6998ec3e8" released by "_create_volume_from_snapshot" :: held 7.912s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.938s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1044307a-0f7f-4610-aa3d-94bd7af50433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7115db99-f046-4e9a-8340-0ef6998ec3e8', 'volume_size': 1, 'snapshot_id': 'ebee526e-b4c9-4c65-870f-762d184c63c5'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10d8a3b-5b6d-4d21-87d7-5aa81a3b8a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:52 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Volume volume-7115db99-f046-4e9a-8340-0ef6998ec3e8 (7115db99-f046-4e9a-8340-0ef6998ec3e8): created successfully
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b10d8a3b-5b6d-4d21-87d7-5aa81a3b8a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Flow 'volume_create_manager' (aa1a5da5-3566-4ce2-8dd3-572049be8df5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:52 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5c6a0ed5-ad8a-4eeb-bac7-11a209c37572 tempest-VolumesDeleteCascade-630047316 None] Created volume successfully.
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-c97ac6c0-247e-411b-9617-fcb723c100ad-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-c97ac6c0-247e-411b-9617-fcb723c100ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Performing cascade delete. {{(pid=88077) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-ebee526e-b4c9-4c65-870f-762d184c63c5-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-ebee526e-b4c9-4c65-870f-762d184c63c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-c97ac6c0-247e-411b-9617-fcb723c100ad" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-c97ac6c0-247e-411b-9617-fcb723c100ad" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-ebee526e-b4c9-4c65-870f-762d184c63c5" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-ebee526e-b4c9-4c65-870f-762d184c63c5" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Deleting offline snapshot ebee526e-b4c9-4c65-870f-762d184c63c5 of volume c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] snapshot_file for this snap is: volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed3ef3c-08c7-42c8-a9f2-61771b183124]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:53 devstack sudo[102186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5
Jul 07 22:50:53 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:53 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5" returned: 0 in 0.835s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97ac6c0-247e-411b-9617-fcb723c100ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d4cdec-3b4a-4755-ba2c-c44926e526cb]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:54 devstack sudo[102191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad
Jul 07 22:50:54 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:54 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad" returned: 0 in 0.895s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:54 devstack sudo[102196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5
Jul 07 22:50:54 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:55 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5" returned: 0 in 0.814s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:55 devstack sudo[102201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5
Jul 07 22:50:55 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:56 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad.ebee526e-b4c9-4c65-870f-762d184c63c5" returned: 0 in 0.697s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-ebee526e-b4c9-4c65-870f-762d184c63c5" released by "_delete_snapshot" :: held 3.346s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-c97ac6c0-247e-411b-9617-fcb723c100ad" released by "delete_snapshot" :: held 3.369s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:56 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Created reservations ['9f4c6a51-4203-48df-a24a-4bbc14d610f0', '5da4dfaf-26ca-489d-bdcd-4609fbce5c93', 'de5dc83c-d5bc-49e5-a924-d84ec0ed2fcf', '9c2c82be-62ea-45db-80ce-2c72247b71bb'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Delete snapshot completed successfully.
Jul 07 22:50:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-ebee526e-b4c9-4c65-870f-762d184c63c5-delete_snapshot" released by "delete_snapshot" :: held 3.531s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Snapshots deleted, issuing volume delete {{(pid=88077) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 07 22:50:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-c97ac6c0-247e-411b-9617-fcb723c100ad" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-c97ac6c0-247e-411b-9617-fcb723c100ad" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:56 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a761bf29-17bc-446e-919e-fb0b90c60bab]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:56 devstack sudo[102205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad
Jul 07 22:50:56 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:57 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad" returned: 0 in 0.819s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:57 devstack sudo[102210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad
Jul 07 22:50:57 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:58 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c97ac6c0-247e-411b-9617-fcb723c100ad" returned: 0 in 0.654s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-c97ac6c0-247e-411b-9617-fcb723c100ad" released by "delete_volume" :: held 1.539s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Created reservations ['09a7bde9-e0b4-4dc6-ae9f-e90b23385a13', '5205682d-6dbb-4185-91ff-55ac00d22d14', 'e5a36301-e8cc-4c31-aaf3-2cbc9a8e3c16', '5dab54a9-0204-4bbe-96ca-df1d63ea2705'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:58 devstack sudo[102213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:50:58 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-7115db99-f046-4e9a-8340-0ef6998ec3e8-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-7115db99-f046-4e9a-8340-0ef6998ec3e8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "cinder-quobyte-7115db99-f046-4e9a-8340-0ef6998ec3e8" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-7115db99-f046-4e9a-8340-0ef6998ec3e8" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74a548c-2d4c-43cf-b381-386a62f687ca]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:58 devstack sudo[102215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8
Jul 07 22:50:58 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:58 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.726s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:58 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:58 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Deleted volume successfully.
Jul 07 22:50:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-973734af-8cf7-4671-9758-ba5f19fa3e69 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-c97ac6c0-247e-411b-9617-fcb723c100ad-delete_volume" released by "delete_volume" :: held 6.049s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:59 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8" returned: 0 in 0.844s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:59 devstack sudo[102221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8
Jul 07 22:50:59 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:00 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7115db99-f046-4e9a-8340-0ef6998ec3e8" returned: 0 in 0.683s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-quobyte-7115db99-f046-4e9a-8340-0ef6998ec3e8" released by "delete_volume" :: held 1.578s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:00 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Created reservations ['4f37bee6-e577-48ec-bb0f-a0ef9065689b', '3ca396a3-9e8f-4714-b3bf-7fe34c8179e6', '1800f201-25b9-4f82-9a87-8739d6cacf9a', '85dd1a6b-777b-4954-b058-4e84149aa4e1'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:00 devstack sudo[102224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:51:00 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:01 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.730s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:01 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:51:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Deleted volume successfully.
Jul 07 22:51:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a2b48608-81e5-4e68-b427-f1c7942ee027 tempest-VolumesDeleteCascade-630047316 None] Lock "cinder-7115db99-f046-4e9a-8340-0ef6998ec3e8-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=45,cinder:UPDATE=48,cinder:INSERT=13,cinder:DELETE=6 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=59,cinder:SELECT=51,cinder:INSERT=15,cinder:DELETE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Flow 'volume_create_manager' (36b756e5-dd6c-46f0-a88b-67dcad08cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22c14f2-d750-46e5-9a17-2663c6e7aca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a22c14f2-d750-46e5-9a17-2663c6e7aca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1273337411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e1a4d2-22de-443d-b347-41afb4a5a089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf197d1b407b4b5aa0fa1e0d5461e593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:05Z,use_quota=True,user_id='636a9fa5c90d4336a49c4e4353e00b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430188d1-530d-4c4c-859e-89053c494498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430188d1-530d-4c4c-859e-89053c494498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c23bea1-77e6-4bcd-a83f-c44f4d40d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c23bea1-77e6-4bcd-a83f-c44f4d40d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80e1a4d2-22de-443d-b347-41afb4a5a089', 'volume_name': 'volume-80e1a4d2-22de-443d-b347-41afb4a5a089', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fba828f-5ea4-40bb-b481-975a8b3cb23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fba828f-5ea4-40bb-b481-975a8b3cb23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db32253-4cbf-4738-95a5-b1d48b009e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:05 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Volume 80e1a4d2-22de-443d-b347-41afb4a5a089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80e1a4d2-22de-443d-b347-41afb4a5a089', 'volume_size': 1}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1273337411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80e1a4d2-22de-443d-b347-41afb4a5a089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf197d1b407b4b5aa0fa1e0d5461e593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:05Z,use_quota=True,user_id='636a9fa5c90d4336a49c4e4353e00b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Creating volume 80e1a4d2-22de-443d-b347-41afb4a5a089 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:51:05 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:51:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:05 devstack sudo[102229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089 1073741824
Jul 07 22:51:05 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:06 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089 1073741824" returned: 0 in 0.805s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:06 devstack sudo[102234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089
Jul 07 22:51:06 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:06 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089" returned: 0 in 0.668s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:51:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db32253-4cbf-4738-95a5-b1d48b009e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e1a4d2-22de-443d-b347-41afb4a5a089', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dd685e-04f9-4e09-bf15-8edb3a37c402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:07 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Volume volume-80e1a4d2-22de-443d-b347-41afb4a5a089 (80e1a4d2-22de-443d-b347-41afb4a5a089): created successfully
Jul 07 22:51:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5dd685e-04f9-4e09-bf15-8edb3a37c402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Flow 'volume_create_manager' (36b756e5-dd6c-46f0-a88b-67dcad08cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:07 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-904e3ea2-f965-4e8b-ad44-5a66dd66592a tempest-VolumesTransfersV357Test-565340599 None] Created volume successfully.
Jul 07 22:51:08 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-7483d088-5996-4dec-95a1-ce0b5b7425b8 tempest-VolumesTransfersV357Test-151180629 None] Transfer volume completed successfully.
Jul 07 22:51:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Acquiring lock "cinder-80e1a4d2-22de-443d-b347-41afb4a5a089-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Lock "cinder-80e1a4d2-22de-443d-b347-41afb4a5a089-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Acquiring lock "cinder-quobyte-80e1a4d2-22de-443d-b347-41afb4a5a089" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Lock "cinder-quobyte-80e1a4d2-22de-443d-b347-41afb4a5a089" acquired by "delete_volume" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:09 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2859eb-3720-4d93-b0c0-80428a461a48]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:09 devstack sudo[102237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089
Jul 07 22:51:09 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:09 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089" returned: 0 in 0.792s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:09 devstack sudo[102242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089
Jul 07 22:51:09 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:10 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-80e1a4d2-22de-443d-b347-41afb4a5a089" returned: 0 in 0.695s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Lock "cinder-quobyte-80e1a4d2-22de-443d-b347-41afb4a5a089" released by "delete_volume" :: held 1.531s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:10 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Created reservations ['f0199613-b739-4ce1-9b73-230df7f83874', 'fc336ab8-cd03-4e95-98d7-959190024577', 'b3241055-da8c-44bc-b0da-809028377405', '32f220b5-cd30-4942-b71c-36a81849d572'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:10 devstack sudo[102246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:51:10 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:11 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.700s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:11 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:51:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Deleted volume successfully.
Jul 07 22:51:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a9b407e9-e1e3-46ed-adc6-dc93984affcb tempest-VolumesTransfersV357Test-785269302 None] Lock "cinder-80e1a4d2-22de-443d-b347-41afb4a5a089-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Flow 'volume_create_manager' (e145a2fa-5290-401e-911b-811fcb27028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a4bc7f-2565-4e2d-93ae-c1e2c8bbada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a4bc7f-2565-4e2d-93ae-c1e2c8bbada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-240850732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647edf37-519d-42c7-93e7-b41762cd9fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf197d1b407b4b5aa0fa1e0d5461e593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:12Z,use_quota=True,user_id='636a9fa5c90d4336a49c4e4353e00b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67f4198-3062-4c45-a87e-08556305060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d67f4198-3062-4c45-a87e-08556305060a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5920c6a4-29a4-41f4-9045-dfe4a95248aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5920c6a4-29a4-41f4-9045-dfe4a95248aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '647edf37-519d-42c7-93e7-b41762cd9fbd', 'volume_name': 'volume-647edf37-519d-42c7-93e7-b41762cd9fbd', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e228f667-ac71-4e77-a391-84f0d2e970da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e228f667-ac71-4e77-a391-84f0d2e970da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbee899-5f71-4f98-aeac-38cee2606c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:12 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Volume 647edf37-519d-42c7-93e7-b41762cd9fbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-647edf37-519d-42c7-93e7-b41762cd9fbd', 'volume_size': 1}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-240850732',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=647edf37-519d-42c7-93e7-b41762cd9fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf197d1b407b4b5aa0fa1e0d5461e593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:12Z,use_quota=True,user_id='636a9fa5c90d4336a49c4e4353e00b8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Creating volume 647edf37-519d-42c7-93e7-b41762cd9fbd {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:51:12 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:12 devstack sudo[102249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd 1073741824
Jul 07 22:51:12 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:12 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd 1073741824" returned: 0 in 0.872s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:13 devstack sudo[102255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd
Jul 07 22:51:13 devstack sudo[102255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:13 devstack sudo[102255]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd" returned: 0 in 0.677s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:51:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbee899-5f71-4f98-aeac-38cee2606c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-647edf37-519d-42c7-93e7-b41762cd9fbd', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3c3cf2-f510-4c13-9c47-9b68cfb924b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:13 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Volume volume-647edf37-519d-42c7-93e7-b41762cd9fbd (647edf37-519d-42c7-93e7-b41762cd9fbd): created successfully
Jul 07 22:51:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd3c3cf2-f510-4c13-9c47-9b68cfb924b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Flow 'volume_create_manager' (e145a2fa-5290-401e-911b-811fcb27028e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e4e745f9-12bb-4e2f-a982-f50d01aa7d7d tempest-VolumesTransfersV357Test-565340599 None] Created volume successfully.
Jul 07 22:51:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Acquiring lock "cinder-647edf37-519d-42c7-93e7-b41762cd9fbd-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Lock "cinder-647edf37-519d-42c7-93e7-b41762cd9fbd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Acquiring lock "cinder-quobyte-647edf37-519d-42c7-93e7-b41762cd9fbd" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Lock "cinder-quobyte-647edf37-519d-42c7-93e7-b41762cd9fbd" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:14 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f57c5e-8cc7-4e35-ae61-65544438131c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:14 devstack sudo[102258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd
Jul 07 22:51:14 devstack sudo[102258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:15 devstack sudo[102258]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd" returned: 0 in 0.785s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:15 devstack sudo[102263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd
Jul 07 22:51:15 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:15 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-647edf37-519d-42c7-93e7-b41762cd9fbd" returned: 0 in 0.693s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Lock "cinder-quobyte-647edf37-519d-42c7-93e7-b41762cd9fbd" released by "delete_volume" :: held 1.516s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:16 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Created reservations ['266f6c66-f085-4fb6-8f75-a0be0d732d62', 'ab2df58b-383f-4cc8-8a39-25b0c0638d9d', '0276699b-1519-42c2-9504-fac531780ae3', '205ccd07-c48b-40e8-a610-4968f8f51c90'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:16 devstack sudo[102268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:51:16 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:16 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.728s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:16 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:51:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Deleted volume successfully.
Jul 07 22:51:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-45229efb-f064-4a05-b6d7-82d9914de785 tempest-VolumesTransfersV357Test-785269302 None] Lock "cinder-647edf37-519d-42c7-93e7-b41762cd9fbd-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:26 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=16,cinder:UPDATE=20,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:51:26 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=12,cinder:UPDATE=23,cinder:DELETE=3,cinder:INSERT=6 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Flow 'volume_create_manager' (c66731e4-75c9-4a70-a8bf-3f287de310ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c59a61-51b5-4458-b40a-66e86d5320fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24c59a61-51b5-4458-b40a-66e86d5320fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1841384710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a8273f-7683-4c36-b682-304521e3b145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac3f8540a7743f6b8fca695971116d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:31Z,use_quota=True,user_id='b36c1193c3e04b9b9b92e6e12efc445d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2f3298-c032-4294-a9fa-7016c6fdb9b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2f3298-c032-4294-a9fa-7016c6fdb9b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a8e209-c295-489c-aea6-689bf6855462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43a8e209-c295-489c-aea6-689bf6855462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a8273f-7683-4c36-b682-304521e3b145', 'volume_name': 'volume-b9a8273f-7683-4c36-b682-304521e3b145', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c52e2d-035a-419f-b6ad-9c10d5b86624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c52e2d-035a-419f-b6ad-9c10d5b86624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e99a01a-441b-4035-9161-be3f2c251fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:31 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Volume b9a8273f-7683-4c36-b682-304521e3b145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a8273f-7683-4c36-b682-304521e3b145', 'volume_size': 1}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1841384710',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a8273f-7683-4c36-b682-304521e3b145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ac3f8540a7743f6b8fca695971116d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:31Z,use_quota=True,user_id='b36c1193c3e04b9b9b92e6e12efc445d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Creating volume b9a8273f-7683-4c36-b682-304521e3b145 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:51:31 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:51:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:31 devstack sudo[102310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 1073741824
Jul 07 22:51:31 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:32 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 1073741824" returned: 0 in 0.845s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:32 devstack sudo[102315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145
Jul 07 22:51:32 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:32 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145" returned: 0 in 0.714s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:51:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e99a01a-441b-4035-9161-be3f2c251fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a8273f-7683-4c36-b682-304521e3b145', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b19f22f-bb97-4e46-8ada-dcdd5a517257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Volume volume-b9a8273f-7683-4c36-b682-304521e3b145 (b9a8273f-7683-4c36-b682-304521e3b145): created successfully
Jul 07 22:51:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b19f22f-bb97-4e46-8ada-dcdd5a517257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Flow 'volume_create_manager' (c66731e4-75c9-4a70-a8bf-3f287de310ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d3109355-70cd-40df-b1f3-e694a86d6914 tempest-VolumesActionsTest-1545924779 None] Created volume successfully.
Jul 07 22:51:43 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:51:43 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:51:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:51:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:43 devstack sudo[102339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:51:43 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:44 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.690s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:51:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:51:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:51:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:51:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-307e2af0-3c64-42cd-a0eb-0c4e415341b7 tempest-VolumesActionsTest-1545924779 None] Acquiring lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145" by "attach_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-307e2af0-3c64-42cd-a0eb-0c4e415341b7 tempest-VolumesActionsTest-1545924779 None] Lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145" acquired by "attach_volume" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:49 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-307e2af0-3c64-42cd-a0eb-0c4e415341b7 tempest-VolumesActionsTest-1545924779 None] Attaching volume b9a8273f-7683-4c36-b682-304521e3b145 to instance 8b62e2e1-5b77-4da3-a09b-17b9bc34a7de at mountpoint /dev/vdb on host None.
Jul 07 22:51:49 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-307e2af0-3c64-42cd-a0eb-0c4e415341b7 tempest-VolumesActionsTest-1545924779 None] Attach volume completed successfully.
Jul 07 22:51:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-307e2af0-3c64-42cd-a0eb-0c4e415341b7 tempest-VolumesActionsTest-1545924779 None] Lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145" released by "attach_volume" :: held 0.100s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-83b1e53b-2ef5-4818-9fdc-d64ca568c198 tempest-VolumesActionsTest-1545924779 None] Acquiring lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145-detach_volume" by "detach_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-83b1e53b-2ef5-4818-9fdc-d64ca568c198 tempest-VolumesActionsTest-1545924779 None] Lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145-detach_volume" acquired by "detach_volume" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:49 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-83b1e53b-2ef5-4818-9fdc-d64ca568c198 tempest-VolumesActionsTest-1545924779 None] Detaching volume b9a8273f-7683-4c36-b682-304521e3b145 from instance 8b62e2e1-5b77-4da3-a09b-17b9bc34a7de.
Jul 07 22:51:49 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-83b1e53b-2ef5-4818-9fdc-d64ca568c198 tempest-VolumesActionsTest-1545924779 None] Detach volume completed successfully.
Jul 07 22:51:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-83b1e53b-2ef5-4818-9fdc-d64ca568c198 tempest-VolumesActionsTest-1545924779 None] Lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145-detach_volume" released by "detach_volume" :: held 0.053s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:59 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:51:59 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:52:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c637aec4-9866-4822-bff5-1f7caa501ca5 tempest-VolumesActionsTest-1545924779 None] Acquiring lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145" by "attach_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c637aec4-9866-4822-bff5-1f7caa501ca5 tempest-VolumesActionsTest-1545924779 None] Lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145" acquired by "attach_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c637aec4-9866-4822-bff5-1f7caa501ca5 tempest-VolumesActionsTest-1545924779 None] Attaching volume b9a8273f-7683-4c36-b682-304521e3b145 to instance 829624a1-76ac-4aec-b03c-058a41f5950d at mountpoint /dev/vdb on host None.
Jul 07 22:52:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c637aec4-9866-4822-bff5-1f7caa501ca5 tempest-VolumesActionsTest-1545924779 None] Attach volume completed successfully.
Jul 07 22:52:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c637aec4-9866-4822-bff5-1f7caa501ca5 tempest-VolumesActionsTest-1545924779 None] Lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145" released by "attach_volume" :: held 0.104s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b2d669d6-4e44-4cf6-8cdb-9d5803d84667 tempest-VolumesActionsTest-1545924779 None] Acquiring lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145-detach_volume" by "detach_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b2d669d6-4e44-4cf6-8cdb-9d5803d84667 tempest-VolumesActionsTest-1545924779 None] Lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b2d669d6-4e44-4cf6-8cdb-9d5803d84667 tempest-VolumesActionsTest-1545924779 None] Detaching volume b9a8273f-7683-4c36-b682-304521e3b145 from instance 829624a1-76ac-4aec-b03c-058a41f5950d.
Jul 07 22:52:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b2d669d6-4e44-4cf6-8cdb-9d5803d84667 tempest-VolumesActionsTest-1545924779 None] Detach volume completed successfully.
Jul 07 22:52:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b2d669d6-4e44-4cf6-8cdb-9d5803d84667 tempest-VolumesActionsTest-1545924779 None] Lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:23 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:52:23 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:INSERT=1,cinder:SELECT=7,cinder:UPDATE=4 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:52:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:24 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ea77b5-05b4-40b6-9d55-8f6a5024166b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:24 devstack sudo[102597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145
Jul 07 22:52:24 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:25 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145" returned: 0 in 0.797s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab03be7c-f0ce-480d-ad81-e4b4202973f8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:25 devstack sudo[102602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145
Jul 07 22:52:25 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:25 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145" returned: 0 in 0.762s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.523df036-f257-43d6-9580-91d222ab03c88rzak8oq.img {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:25 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.523df036-f257-43d6-9580-91d222ab03c88rzak8oq.img
Jul 07 22:52:25 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:29 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.523df036-f257-43d6-9580-91d222ab03c88rzak8oq.img" returned: 0 in 4.051s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:29 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[49878150-0fa3-441b-981f-e9c8f520dc7c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:30 devstack sudo[102620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145
Jul 07 22:52:30 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:30 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145" returned: 0 in 0.925s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:30 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.523df036-f257-43d6-9580-91d222ab03c88rzak8oq.img {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:52:30 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Converted 1024.00 MB image at 252.68 MB/s
Jul 07 22:52:30 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] 523df036-f257-43d6-9580-91d222ab03c8 was raw, no need to convert to raw {{(pid=88077) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 07 22:52:40 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:52:40 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:52:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:52:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:43 devstack sudo[102628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:52:43 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:44 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.700s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:52:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:52:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:52:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:52:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.155s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Uploaded volume to glance image-id: 523df036-f257-43d6-9580-91d222ab03c8. {{(pid=88077) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 07 22:52:50 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-36cf0ceb-6eeb-430b-87d5-44b591914936 tempest-VolumesActionsTest-1545924779 None] Copy volume to image completed successfully.
Jul 07 22:52:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:52 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfea04f-85fc-4359-b310-204e324285c5]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:52 devstack sudo[102638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145
Jul 07 22:52:52 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:53 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145" returned: 0 in 0.816s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:53 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27838c7-c82a-4a7e-a7a6-fbaca9a84b5b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:53 devstack sudo[102643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145
Jul 07 22:52:53 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:53 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145" returned: 0 in 0.778s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:53 devstack sudo[102648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img
Jul 07 22:52:54 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:58 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img" returned: 0 in 4.275s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:58 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee6b5e1-49a2-4da6-a2df-f58621840364]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:58 devstack sudo[102661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145
Jul 07 22:52:58 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:59 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145" returned: 0 in 0.942s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:59 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145, size 1024.00 MB, duration 4.28 sec, destination /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:52:59 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Converted 1024.00 MB image at 239.49 MB/s
Jul 07 22:52:59 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] 017db0c5-b633-4b29-a354-c2eaf6750c80 was raw, converting to qcow2 {{(pid=88077) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 07 22:52:59 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfb4602-9c67-4802-8a02-e31f86adaff1]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:59 devstack sudo[102666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img
Jul 07 22:52:59 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:59 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img" returned: 0 in 0.737s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:00 devstack sudo[102670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img
Jul 07 22:53:00 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:00 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img" returned: 1 in 0.788s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:53:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img /opt/stack/data/cinder/conversion/vol_upload_2me6592a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:00 devstack sudo[102676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img /opt/stack/data/cinder/conversion/vol_upload_2me6592a
Jul 07 22:53:00 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:01 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img /opt/stack/data/cinder/conversion/vol_upload_2me6592a" returned: 0 in 0.650s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:01 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Image conversion details: src /opt/stack/data/cinder/conversion/b9a8273f-7683-4c36-b682-304521e3b145.temp_image.017db0c5-b633-4b29-a354-c2eaf6750c8006q9n6po.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2me6592a {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:53:01 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 07 22:53:01 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e7a77-c0b8-4e17-9491-74dc871cee4d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2me6592a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:01 devstack sudo[102681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2me6592a
Jul 07 22:53:01 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:02 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2me6592a" returned: 0 in 0.767s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.201s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Uploaded volume to glance image-id: 017db0c5-b633-4b29-a354-c2eaf6750c80. {{(pid=88077) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 07 22:53:03 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-eb04070f-a2d2-4304-86ae-cfecd299ebee tempest-VolumesActionsTest-1545924779 None] Copy volume to image completed successfully.
Jul 07 22:53:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Acquiring lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Acquiring lock "cinder-quobyte-b9a8273f-7683-4c36-b682-304521e3b145" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Lock "cinder-quobyte-b9a8273f-7683-4c36-b682-304521e3b145" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:04 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[110dfcd4-9c3f-4473-8a8a-f177efa07cd1]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:04 devstack sudo[102687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145
Jul 07 22:53:04 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:05 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145" returned: 0 in 0.767s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:05 devstack sudo[102692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145
Jul 07 22:53:05 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:06 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9a8273f-7683-4c36-b682-304521e3b145" returned: 0 in 0.681s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Lock "cinder-quobyte-b9a8273f-7683-4c36-b682-304521e3b145" released by "delete_volume" :: held 1.486s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Created reservations ['3eb781a9-c592-4099-a8e8-1db361ce6fcb', '05a5b492-0f5a-4034-8314-23b206c04426', 'a25feb92-e697-4a42-a5b1-48c282fe401c', '25c486f9-7dc5-442e-8bd7-f4acb8f7cf55'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:06 devstack sudo[102695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:53:06 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:06 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.671s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:53:06 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Deleted volume successfully.
Jul 07 22:53:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-17668140-947c-41ca-b8f4-398c4b04b55c tempest-VolumesActionsTest-1545924779 None] Lock "cinder-b9a8273f-7683-4c36-b682-304521e3b145-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Flow 'volume_create_manager' (723f26a3-4783-4bb2-b64a-eb14f5e50f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50ecf26-010c-4653-a187-626234255e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e50ecf26-010c-4653-a187-626234255e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1543188530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287a9faa-694c-49fc-9362-cfdcf540c723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfca3495c0bd4b7ea99744180c53b3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:14Z,use_quota=True,user_id='568de85dcfae404496037c1a248ed785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd421ea-36e6-4cbe-a4e6-90f3de29c0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd421ea-36e6-4cbe-a4e6-90f3de29c0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dacf3eca-1839-40e9-b37b-0690cf6e8a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.image.glance [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Creating Keystone auth plugin from conf {{(pid=88077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dacf3eca-1839-40e9-b37b-0690cf6e8a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '287a9faa-694c-49fc-9362-cfdcf540c723', 'volume_name': 'volume-287a9faa-694c-49fc-9362-cfdcf540c723', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72fba690>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b2e931-0c5c-4175-8aa1-2347f525dfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b2e931-0c5c-4175-8aa1-2347f525dfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f27bd4-d7f9-4e28-b9b1-6201b53052eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:13 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Volume 287a9faa-694c-49fc-9362-cfdcf540c723: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-287a9faa-694c-49fc-9362-cfdcf540c723', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72fba690>}
Jul 07 22:53:13 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Trying to clone 287a9faa-694c-49fc-9362-cfdcf540c723 from image 92445205-e8e3-4b89-b69d-7e05b2a64f9f at location (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]). {{(pid=88077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:53:14 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:53:14 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 22:53:14 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[978116e7-4b1b-4bb2-9a0f-7a8e072d42c8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:14 devstack sudo[102704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD
Jul 07 22:53:14 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:15 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD" returned: 0 in 0.836s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Temporary image 92445205-e8e3-4b89-b69d-7e05b2a64f9f is fetched for user 568de85dcfae404496037c1a248ed785. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bb1ebf-f336-4ebc-8b7e-9e5b3b0fc618]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:15 devstack sudo[102709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD
Jul 07 22:53:15 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:15 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD" returned: 0 in 0.761s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:53:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1543188530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287a9faa-694c-49fc-9362-cfdcf540c723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfca3495c0bd4b7ea99744180c53b3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:14Z,use_quota=True,user_id='568de85dcfae404496037c1a248ed785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Creating volume 287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:53:15 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:53:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:15 devstack sudo[102716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 1073741824
Jul 07 22:53:15 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:16 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 1073741824" returned: 0 in 0.843s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:16 devstack sudo[102722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723
Jul 07 22:53:16 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:17 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723" returned: 0 in 0.620s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:53:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:17 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Attempting download of 92445205-e8e3-4b89-b69d-7e05b2a64f9f ((None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}])) to volume 287a9faa-694c-49fc-9362-cfdcf540c723. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:53:17 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffff1f0-e13e-4c5b-a17c-6fd73ed4fa9a]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_n009pt_n {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:17 devstack sudo[102725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_n009pt_n
Jul 07 22:53:17 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:18 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_n009pt_n" returned: 0 in 0.762s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_n009pt_n {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:18 devstack sudo[102729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_n009pt_n
Jul 07 22:53:18 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:19 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_n009pt_n" returned: 1 in 0.773s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92445205-e8e3-4b89-b69d-7e05b2a64f9f_n009pt_n' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:53:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c75b75-0ad7-4ce0-b54c-9ffaea166e32]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:19 devstack sudo[102734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD
Jul 07 22:53:19 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:19 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD" returned: 0 in 0.756s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:19 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] 92445205-e8e3-4b89-b69d-7e05b2a64f9f was qcow2, converting to raw {{(pid=88077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:53:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:19 devstack sudo[102739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723
Jul 07 22:53:19 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:21 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723" returned: 0 in 1.992s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:21 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92445205-e8e3-4b89-b69d-7e05b2a64f9f_7jp0dif8devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:53:21 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Converted 112.00 MB image at 56.18 MB/s
Jul 07 22:53:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:21 devstack sudo[102788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 1G
Jul 07 22:53:21 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:22 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 1G" returned: 0 in 0.694s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd16124-9867-48d8-951f-bd37caf92065]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:22 devstack sudo[102793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723
Jul 07 22:53:22 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:23 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723" returned: 0 in 0.795s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:23 devstack sudo[102797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723
Jul 07 22:53:23 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:24 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723" returned: 1 in 0.814s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Downloaded image 92445205-e8e3-4b89-b69d-7e05b2a64f9f ((None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}])) to volume 287a9faa-694c-49fc-9362-cfdcf540c723 successfully. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Temporary image 92445205-e8e3-4b89-b69d-7e05b2a64f9f for user 568de85dcfae404496037c1a248ed785 is deleted. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Marking volume 287a9faa-694c-49fc-9362-cfdcf540c723 as bootable. {{(pid=88077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Copying metadata from image 92445205-e8e3-4b89-b69d-7e05b2a64f9f to 287a9faa-694c-49fc-9362-cfdcf540c723. {{(pid=88077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Creating volume glance metadata for volume 287a9faa-694c-49fc-9362-cfdcf540c723 backed by image 92445205-e8e3-4b89-b69d-7e05b2a64f9f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36f27bd4-d7f9-4e28-b9b1-6201b53052eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287a9faa-694c-49fc-9362-cfdcf540c723', 'volume_size': 1, 'image_id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '976a5abf12f94b70b7f1f6ce66aa7ca9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '92445205-e8e3-4b89-b69d-7e05b2a64f9f', 'created_at': datetime.datetime(2026, 7, 7, 20, 26, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 26, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92445205-e8e3-4b89-b69d-7e05b2a64f9f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72fba690>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4a05f2-9a40-4b4e-a0c7-5d84da13f1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:24 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Volume volume-287a9faa-694c-49fc-9362-cfdcf540c723 (287a9faa-694c-49fc-9362-cfdcf540c723): created successfully
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b4a05f2-9a40-4b4e-a0c7-5d84da13f1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:24 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Flow 'volume_create_manager' (723f26a3-4783-4bb2-b64a-eb14f5e50f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:53:24 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-866dad4c-ae35-4a07-9bde-d4eb95571548 tempest-VolumesExtendTest-1886248270 None] Created volume successfully.
Jul 07 22:53:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb71a71c-0d15-4b8a-a50c-5f94c971bce4]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:25 devstack sudo[102802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723
Jul 07 22:53:25 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:26 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723" returned: 0 in 0.821s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:26 devstack sudo[102806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723
Jul 07 22:53:26 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:26 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723" returned: 1 in 0.791s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:53:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 2G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 2G" returned: 0 in 0.065s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.748s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a640ceda-b4e7-492a-aadb-049c6b238ca9 tempest-VolumesExtendTest-1886248270 None] Extend volume completed successfully.
Jul 07 22:53:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Acquiring lock "cinder-287a9faa-694c-49fc-9362-cfdcf540c723-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Lock "cinder-287a9faa-694c-49fc-9362-cfdcf540c723-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Acquiring lock "cinder-quobyte-287a9faa-694c-49fc-9362-cfdcf540c723" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Lock "cinder-quobyte-287a9faa-694c-49fc-9362-cfdcf540c723" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:27 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa80ec7-3107-4333-9eca-98e767a8e5cf]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:28 devstack sudo[102814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723
Jul 07 22:53:28 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:28 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723" returned: 0 in 0.916s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:28 devstack sudo[102818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723
Jul 07 22:53:28 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:29 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723" returned: 1 in 0.844s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:53:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:29 devstack sudo[102823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723
Jul 07 22:53:29 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:30 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-287a9faa-694c-49fc-9362-cfdcf540c723" returned: 0 in 0.754s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Lock "cinder-quobyte-287a9faa-694c-49fc-9362-cfdcf540c723" released by "delete_volume" :: held 2.592s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:30 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Created reservations ['0fb77779-6cea-4c80-9683-9b3eadb83268', 'c7faa0a9-7f6d-4662-8162-1cf23dc5acc4', '9c380a47-003b-4468-8c4b-7c9b7cffb6ba', '31aa4716-920d-4218-9f47-767737162d38'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:53:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:53:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:53:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:30 devstack sudo[102826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:53:30 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:31 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.682s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:53:31 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Deleted volume successfully.
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7a54f10b-374e-47ac-9441-8187cdd359af tempest-VolumesExtendTest-1886248270 None] Lock "cinder-287a9faa-694c-49fc-9362-cfdcf540c723-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Flow 'volume_create_manager' (7c5d8aaf-b272-4866-9aa2-08786c304064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfca2b4-c3ac-422c-80ae-1586aa9bd96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bfca2b4-c3ac-422c-80ae-1586aa9bd96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2014076684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c411eee-2a24-4efe-825e-70c4556587f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfca3495c0bd4b7ea99744180c53b3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:32Z,use_quota=True,user_id='568de85dcfae404496037c1a248ed785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98dccd67-74ae-4db1-bcaa-a68fc6e40067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98dccd67-74ae-4db1-bcaa-a68fc6e40067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8d2af6-d1c0-4742-908e-90b6d365856a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8d2af6-d1c0-4742-908e-90b6d365856a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c411eee-2a24-4efe-825e-70c4556587f6', 'volume_name': 'volume-3c411eee-2a24-4efe-825e-70c4556587f6', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad0d31b-3b92-434d-a662-854c5db0ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cad0d31b-3b92-434d-a662-854c5db0ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33346209-0095-4a65-b524-b983a360acfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:31 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Volume 3c411eee-2a24-4efe-825e-70c4556587f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c411eee-2a24-4efe-825e-70c4556587f6', 'volume_size': 1}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2014076684',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c411eee-2a24-4efe-825e-70c4556587f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfca3495c0bd4b7ea99744180c53b3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:32Z,use_quota=True,user_id='568de85dcfae404496037c1a248ed785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Creating volume 3c411eee-2a24-4efe-825e-70c4556587f6 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:53:31 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:53:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:31 devstack sudo[102830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6 1073741824
Jul 07 22:53:31 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:32 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6 1073741824" returned: 0 in 0.889s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:32 devstack sudo[102836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6
Jul 07 22:53:32 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:33 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6" returned: 0 in 0.629s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33346209-0095-4a65-b524-b983a360acfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c411eee-2a24-4efe-825e-70c4556587f6', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f62572-3c72-4342-bb23-f6c99cd367a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Volume volume-3c411eee-2a24-4efe-825e-70c4556587f6 (3c411eee-2a24-4efe-825e-70c4556587f6): created successfully
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f62572-3c72-4342-bb23-f6c99cd367a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Flow 'volume_create_manager' (7c5d8aaf-b272-4866-9aa2-08786c304064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:53:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-17152f66-00b8-4e0d-8c90-47ca4a4d010e tempest-VolumesExtendTest-1886248270 None] Created volume successfully.
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Creating offline snapshot cf790ff0-9c44-472b-abc0-1e2f1c3b001e of volume 3c411eee-2a24-4efe-825e-70c4556587f6 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[37792be2-cd18-44e3-9f58-b5a14005b83f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:33 devstack sudo[102839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6
Jul 07 22:53:33 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:34 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6" returned: 0 in 0.785s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:34 devstack sudo[102844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e 1G
Jul 07 22:53:34 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:35 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e 1G" returned: 0 in 0.812s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c411eee-2a24-4efe-825e-70c4556587f6 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:35 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c411eee-2a24-4efe-825e-70c4556587f6 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e
Jul 07 22:53:35 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:36 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c411eee-2a24-4efe-825e-70c4556587f6 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e" returned: 0 in 0.677s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:36 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e is being set with open permissions: ugo+rw
Jul 07 22:53:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:36 devstack sudo[102855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e
Jul 07 22:53:36 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:36 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e" returned: 0 in 0.663s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:36 devstack sudo[102858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.info
Jul 07 22:53:36 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:37 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.info" returned: 0 in 0.685s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:37 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.info is being set with open permissions: ugo+rw
Jul 07 22:53:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:37 devstack sudo[102861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.info
Jul 07 22:53:37 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:38 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.info" returned: 0 in 0.670s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.385s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:38 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5253198e-fa27-43e1-9bd9-ec0938e18fcf tempest-VolumesExtendTest-1886248270 None] Create snapshot completed successfully
Jul 07 22:53:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8247af0b-83bb-4e6d-b41f-f00f9a68b082 tempest-VolumesExtendTest-1886248270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8247af0b-83bb-4e6d-b41f-f00f9a68b082 tempest-VolumesExtendTest-1886248270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:39 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2d4663-215c-4f01-a9d1-ae9b617d1c84]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8247af0b-83bb-4e6d-b41f-f00f9a68b082 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:39 devstack sudo[102864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6
Jul 07 22:53:39 devstack sudo[102864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:39 devstack sudo[102864]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8247af0b-83bb-4e6d-b41f-f00f9a68b082 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6" returned: 0 in 0.758s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8247af0b-83bb-4e6d-b41f-f00f9a68b082 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e 2G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8247af0b-83bb-4e6d-b41f-f00f9a68b082 tempest-VolumesExtendTest-1886248270 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e 2G" returned: 0 in 0.124s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8247af0b-83bb-4e6d-b41f-f00f9a68b082 tempest-VolumesExtendTest-1886248270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.919s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:40 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8247af0b-83bb-4e6d-b41f-f00f9a68b082 tempest-VolumesExtendTest-1886248270 None] Extend volume completed successfully.
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Acquiring lock "cinder-cf790ff0-9c44-472b-abc0-1e2f1c3b001e-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Lock "cinder-cf790ff0-9c44-472b-abc0-1e2f1c3b001e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Acquiring lock "cinder-quobyte-3c411eee-2a24-4efe-825e-70c4556587f6" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Lock "cinder-quobyte-3c411eee-2a24-4efe-825e-70c4556587f6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Acquiring lock "cinder-quobyte-cf790ff0-9c44-472b-abc0-1e2f1c3b001e" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Lock "cinder-quobyte-cf790ff0-9c44-472b-abc0-1e2f1c3b001e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Deleting offline snapshot cf790ff0-9c44-472b-abc0-1e2f1c3b001e of volume 3c411eee-2a24-4efe-825e-70c4556587f6 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] snapshot_file for this snap is: volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf596cc-b9d0-4ca5-b96b-56d6a47b4e70]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:40 devstack sudo[102872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e
Jul 07 22:53:40 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:41 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e" returned: 0 in 0.758s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c411eee-2a24-4efe-825e-70c4556587f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:53:41 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc4937f-6535-47e6-8b7b-c60c3d4c56dc]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:41 devstack sudo[102878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6
Jul 07 22:53:41 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:42 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6" returned: 0 in 0.874s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:42 devstack sudo[102883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e
Jul 07 22:53:42 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:43 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e" returned: 0 in 0.857s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:43 devstack sudo[102888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e
Jul 07 22:53:43 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:43 devstack sudo[102890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:53:43 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:43 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6.cf790ff0-9c44-472b-abc0-1e2f1c3b001e" returned: 0 in 0.726s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=32,cinder:UPDATE=29,cinder:INSERT=10,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Lock "cinder-quobyte-cf790ff0-9c44-472b-abc0-1e2f1c3b001e" released by "_delete_snapshot" :: held 3.327s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Lock "cinder-quobyte-3c411eee-2a24-4efe-825e-70c4556587f6" released by "delete_snapshot" :: held 3.352s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Created reservations ['cfd6d082-c4b6-449c-9dfe-ead257373a97', 'f81df762-cf5e-4434-b89c-3775528de357', '21307881-b08a-4727-8886-cd7e72345459', 'db410bbb-6ad3-4ea1-b108-7b12ecb6f7b8'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:53:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Delete snapshot completed successfully.
Jul 07 22:53:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1bcd3db9-6867-49f3-aef4-651f45af811c tempest-VolumesExtendTest-1886248270 None] Lock "cinder-cf790ff0-9c44-472b-abc0-1e2f1c3b001e-delete_snapshot" released by "delete_snapshot" :: held 3.520s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:44 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.716s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Acquiring lock "cinder-3c411eee-2a24-4efe-825e-70c4556587f6-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Lock "cinder-3c411eee-2a24-4efe-825e-70c4556587f6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Acquiring lock "cinder-quobyte-3c411eee-2a24-4efe-825e-70c4556587f6" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Lock "cinder-quobyte-3c411eee-2a24-4efe-825e-70c4556587f6" acquired by "delete_volume" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6ba451-4c66-4ad4-a2a2-ea505801628f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:44 devstack sudo[102900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6
Jul 07 22:53:44 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:45 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6" returned: 0 in 0.764s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:45 devstack sudo[102905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6
Jul 07 22:53:45 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:46 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3c411eee-2a24-4efe-825e-70c4556587f6" returned: 0 in 0.707s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Lock "cinder-quobyte-3c411eee-2a24-4efe-825e-70c4556587f6" released by "delete_volume" :: held 1.528s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:46 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Created reservations ['86e8f831-9801-42fd-b5bc-861dd7f28a27', 'c44af977-3cff-4fb2-812a-c5ca07c41a94', '346c464d-2cb6-4118-b6b1-2c5bd2289659', 'd0e206f8-469b-419b-a706-0bc42e0b09fb'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:53:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:53:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:53:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:46 devstack sudo[102908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:53:46 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:47 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.687s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:47 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:53:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Deleted volume successfully.
Jul 07 22:53:47 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-02380e69-596d-48f9-b198-6ad43443cc40 tempest-VolumesExtendTest-1886248270 None] Lock "cinder-3c411eee-2a24-4efe-825e-70c4556587f6-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:56 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=9,cinder:INSERT=5,cinder:UPDATE=14 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:53:57 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=42,cinder:UPDATE=47,cinder:INSERT=17,cinder:DELETE=4 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Flow 'volume_create_manager' (934b3a99-e687-43ca-9bad-24f11c393719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92a0bd9-d981-4381-bece-2579c146f642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e92a0bd9-d981-4381-bece-2579c146f642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-714860793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c2ba36-8b06-44a5-8077-ecda2eddeef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7710a1f2abe742a497467a2c4d9be43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:58Z,use_quota=True,user_id='f2f8ebec41634e55b03252eb06c8d573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae7a723-cb7a-4d7c-9673-67c81e455742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae7a723-cb7a-4d7c-9673-67c81e455742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdbb15c-0f05-4785-b120-4a4819abb700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbdbb15c-0f05-4785-b120-4a4819abb700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c2ba36-8b06-44a5-8077-ecda2eddeef3', 'volume_name': 'volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e459acc0-27e8-40b3-8b23-6e0fff2c4f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e459acc0-27e8-40b3-8b23-6e0fff2c4f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360dd6cd-6265-4ec4-9084-d7eafcb71c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:58 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Volume 20c2ba36-8b06-44a5-8077-ecda2eddeef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3', 'volume_size': 1}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-714860793',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c2ba36-8b06-44a5-8077-ecda2eddeef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7710a1f2abe742a497467a2c4d9be43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:53:58Z,use_quota=True,user_id='f2f8ebec41634e55b03252eb06c8d573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Creating volume 20c2ba36-8b06-44a5-8077-ecda2eddeef3 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:53:58 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:53:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:58 devstack sudo[102912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 1073741824
Jul 07 22:53:58 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:59 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 1073741824" returned: 0 in 0.894s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:59 devstack sudo[102918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3
Jul 07 22:53:59 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:59 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3" returned: 0 in 0.657s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:53:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (360dd6cd-6265-4ec4-9084-d7eafcb71c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbcfa91-8847-49b0-a3ce-4513d19867b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:53:59 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Volume volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 (20c2ba36-8b06-44a5-8077-ecda2eddeef3): created successfully
Jul 07 22:53:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbcfa91-8847-49b0-a3ce-4513d19867b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:53:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Flow 'volume_create_manager' (934b3a99-e687-43ca-9bad-24f11c393719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:53:59 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8dda36e7-c199-4dee-bbb5-1af5aa473b0b tempest-VolumesSnapshotTestJSON-741309696 None] Created volume successfully.
Jul 07 22:54:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Creating offline snapshot a8609743-d024-4fb1-b7aa-8220278ebafc of volume 20c2ba36-8b06-44a5-8077-ecda2eddeef3 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:54:00 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa61c4a-82b8-47d0-8004-ec671b2a3fea]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:00 devstack sudo[102921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3
Jul 07 22:54:00 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:01 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3" returned: 0 in 0.809s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:01 devstack sudo[102927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc 1G
Jul 07 22:54:01 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:02 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc 1G" returned: 0 in 0.934s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:02 devstack sudo[102933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc
Jul 07 22:54:02 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:03 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc" returned: 0 in 0.833s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:03 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc is being set with open permissions: ugo+rw
Jul 07 22:54:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:03 devstack sudo[102938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc
Jul 07 22:54:03 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:03 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc" returned: 0 in 0.715s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:03 devstack sudo[102941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.info
Jul 07 22:54:03 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:04 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.info" returned: 0 in 0.767s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:04 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.info is being set with open permissions: ugo+rw
Jul 07 22:54:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:04 devstack sudo[102944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.info
Jul 07 22:54:04 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:05 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.info" returned: 0 in 0.742s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.900s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:05 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-25459046-0e0a-4656-a0e6-65902f5b5834 tempest-VolumesSnapshotTestJSON-741309696 None] Create snapshot completed successfully
Jul 07 22:54:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-a8609743-d024-4fb1-b7aa-8220278ebafc-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-a8609743-d024-4fb1-b7aa-8220278ebafc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-20c2ba36-8b06-44a5-8077-ecda2eddeef3" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-20c2ba36-8b06-44a5-8077-ecda2eddeef3" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-a8609743-d024-4fb1-b7aa-8220278ebafc" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-a8609743-d024-4fb1-b7aa-8220278ebafc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Deleting offline snapshot a8609743-d024-4fb1-b7aa-8220278ebafc of volume 20c2ba36-8b06-44a5-8077-ecda2eddeef3 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] snapshot_file for this snap is: volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b0e6d0-956b-4807-958f-64724a8c2445]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:06 devstack sudo[102947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc
Jul 07 22:54:06 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:06 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc" returned: 0 in 0.814s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdc4e6c-a8f1-4c23-bf64-482af3a2cc9c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:07 devstack sudo[102952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3
Jul 07 22:54:07 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:07 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3" returned: 0 in 0.894s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:07 devstack sudo[102957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc
Jul 07 22:54:07 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:08 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc" returned: 0 in 0.786s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:08 devstack sudo[102962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc
Jul 07 22:54:08 devstack sudo[102962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:09 devstack sudo[102962]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3.a8609743-d024-4fb1-b7aa-8220278ebafc" returned: 0 in 0.741s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-a8609743-d024-4fb1-b7aa-8220278ebafc" released by "_delete_snapshot" :: held 3.370s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-20c2ba36-8b06-44a5-8077-ecda2eddeef3" released by "delete_snapshot" :: held 3.392s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:09 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Created reservations ['617d9b3b-7f87-4708-89a7-b19e47a35678', '07b2f3fc-fc85-4945-ac72-9e033c0ab014', '6c574998-c5af-4989-b013-7955692a3319', '34263fb8-c02e-440a-b6f8-5d3ae68bd443'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:54:09 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Delete snapshot completed successfully.
Jul 07 22:54:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff89a4a-51cf-41f7-8d0b-3edb4dc54465 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-a8609743-d024-4fb1-b7aa-8220278ebafc-delete_snapshot" released by "delete_snapshot" :: held 3.581s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Flow 'volume_create_manager' (1d606dcf-32eb-49b1-8bd8-da5874faf7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8e5a76-d006-4218-8940-0e92002b8629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e8e5a76-d006-4218-8940-0e92002b8629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1470122448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11446b4-b162-4ebe-932a-1f7a5c49a8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7710a1f2abe742a497467a2c4d9be43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:11Z,use_quota=True,user_id='f2f8ebec41634e55b03252eb06c8d573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf1b5a7-cfef-4113-8de0-8e607762033a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf1b5a7-cfef-4113-8de0-8e607762033a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbad5307-5a40-49a3-abef-88797561d619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbad5307-5a40-49a3-abef-88797561d619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e11446b4-b162-4ebe-932a-1f7a5c49a8b9', 'volume_name': 'volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022c0302-565f-4f19-858f-e2867f3a4657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022c0302-565f-4f19-858f-e2867f3a4657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5027d9cd-02f2-44c0-9819-502e0421c589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:10 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Volume e11446b4-b162-4ebe-932a-1f7a5c49a8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9', 'volume_size': 1}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1470122448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e11446b4-b162-4ebe-932a-1f7a5c49a8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7710a1f2abe742a497467a2c4d9be43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:11Z,use_quota=True,user_id='f2f8ebec41634e55b03252eb06c8d573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Creating volume e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:54:10 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:54:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:10 devstack sudo[102966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 1073741824
Jul 07 22:54:10 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:11 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 1073741824" returned: 0 in 0.913s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:11 devstack sudo[102971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9
Jul 07 22:54:11 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:12 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" returned: 0 in 0.741s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:54:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5027d9cd-02f2-44c0-9819-502e0421c589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c984c01-050d-4f5e-ad22-b20d1bb327e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:12 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Volume volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 (e11446b4-b162-4ebe-932a-1f7a5c49a8b9): created successfully
Jul 07 22:54:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c984c01-050d-4f5e-ad22-b20d1bb327e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Flow 'volume_create_manager' (1d606dcf-32eb-49b1-8bd8-da5874faf7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:54:12 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1881c2d2-7d97-4893-af31-cbf27a72b1c4 tempest-VolumesSnapshotTestJSON-741309696 None] Created volume successfully.
Jul 07 22:54:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Creating offline snapshot 45258a9f-629e-4311-9f03-896e895767b5 of volume e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:54:13 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6acd54a-a806-4b86-96e2-6a236134fad0]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:13 devstack sudo[102975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9
Jul 07 22:54:13 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:13 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" returned: 0 in 0.773s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:14 devstack sudo[102980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 1G
Jul 07 22:54:14 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:14 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 1G" returned: 0 in 0.829s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:14 devstack sudo[102985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5
Jul 07 22:54:14 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:15 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5" returned: 0 in 0.758s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:15 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 is being set with open permissions: ugo+rw
Jul 07 22:54:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:15 devstack sudo[102992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5
Jul 07 22:54:15 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:16 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5" returned: 0 in 0.717s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:16 devstack sudo[102995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.info
Jul 07 22:54:16 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:16 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.info" returned: 0 in 0.655s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:16 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.info is being set with open permissions: ugo+rw
Jul 07 22:54:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:17 devstack sudo[102998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.info
Jul 07 22:54:17 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:17 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.info" returned: 0 in 0.709s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.526s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:17 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6a105d0f-679e-4b68-a364-a6813b9bdf44 tempest-VolumesSnapshotTestJSON-741309696 None] Create snapshot completed successfully
Jul 07 22:54:18 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:54:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Flow 'volume_create_manager' (f4f1d469-d3be-43b3-9857-4e5c780ad5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a8a95b-e80b-479a-bc65-45c8be07cabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a8a95b-e80b-479a-bc65-45c8be07cabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-688346037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acf3d995-100a-4769-8983-66fcfbe26811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7710a1f2abe742a497467a2c4d9be43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=45258a9f-629e-4311-9f03-896e895767b5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:19Z,use_quota=True,user_id='f2f8ebec41634e55b03252eb06c8d573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19d6532-86b3-4e10-b1d0-93ce74ca86a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f19d6532-86b3-4e10-b1d0-93ce74ca86a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d72dd65-75a2-43b2-b7ad-1b75a5d3769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d72dd65-75a2-43b2-b7ad-1b75a5d3769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'acf3d995-100a-4769-8983-66fcfbe26811', 'volume_name': 'volume-acf3d995-100a-4769-8983-66fcfbe26811', 'volume_size': 2, 'snapshot_id': '45258a9f-629e-4311-9f03-896e895767b5'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8a73e3-963c-42f2-8fbd-c3648b594703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e8a73e3-963c-42f2-8fbd-c3648b594703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62826831-6191-42d4-9cd5-f4855a6c4a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:19 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Volume acf3d995-100a-4769-8983-66fcfbe26811: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-acf3d995-100a-4769-8983-66fcfbe26811', 'volume_size': 2, 'snapshot_id': '45258a9f-629e-4311-9f03-896e895767b5'}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-45258a9f-629e-4311-9f03-896e895767b5-acf3d995-100a-4769-8983-66fcfbe26811" by "_create_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-45258a9f-629e-4311-9f03-896e895767b5-acf3d995-100a-4769-8983-66fcfbe26811" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Creating volume acf3d995-100a-4769-8983-66fcfbe26811 from snapshot 45258a9f-629e-4311-9f03-896e895767b5 {{(pid=88077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-acf3d995-100a-4769-8983-66fcfbe26811" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-acf3d995-100a-4769-8983-66fcfbe26811" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] snapshot: 45258a9f-629e-4311-9f03-896e895767b5, volume: acf3d995-100a-4769-8983-66fcfbe26811,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5367ab0a-cb25-41e2-b7aa-d2b76ab63a9f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:19 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5
Jul 07 22:54:19 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:19 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5" returned: 0 in 0.771s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc08283b-b47a-43e4-8a9c-680c78ffcb87]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:20 devstack sudo[103008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9
Jul 07 22:54:20 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:20 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" returned: 0 in 0.781s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:20 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811 not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:54:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:20 devstack sudo[103014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811
Jul 07 22:54:20 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:25 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811" returned: 0 in 4.391s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4e7c2b-5e84-402e-bb30-d6dec95e813f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:25 devstack sudo[103063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9
Jul 07 22:54:25 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:26 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" returned: 0 in 1.010s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9, size 1024.00 MB, duration 4.39 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:54:26 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Converted 1024.00 MB image at 233.13 MB/s
Jul 07 22:54:26 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811 is being set with open permissions: ugo+rw
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:26 devstack sudo[103069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811
Jul 07 22:54:26 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:26 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811" returned: 0 in 0.664s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-acf3d995-100a-4769-8983-66fcfbe26811" released by "_copy_volume_from_snapshot" :: held 7.724s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-45258a9f-629e-4311-9f03-896e895767b5-acf3d995-100a-4769-8983-66fcfbe26811" released by "_create_volume_from_snapshot" :: held 7.756s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.774s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62826831-6191-42d4-9cd5-f4855a6c4a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acf3d995-100a-4769-8983-66fcfbe26811', 'volume_size': 2, 'snapshot_id': '45258a9f-629e-4311-9f03-896e895767b5'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82938b00-f76a-4c82-885a-8226967cd3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:26 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Volume volume-acf3d995-100a-4769-8983-66fcfbe26811 (acf3d995-100a-4769-8983-66fcfbe26811): created successfully
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82938b00-f76a-4c82-885a-8226967cd3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:26 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Flow 'volume_create_manager' (f4f1d469-d3be-43b3-9857-4e5c780ad5a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:54:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-87e286eb-e34e-4cab-b7c5-0b58e2c0f5e5 tempest-VolumesSnapshotTestJSON-741309696 None] Created volume successfully.
Jul 07 22:54:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-acf3d995-100a-4769-8983-66fcfbe26811-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-acf3d995-100a-4769-8983-66fcfbe26811-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-acf3d995-100a-4769-8983-66fcfbe26811" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-acf3d995-100a-4769-8983-66fcfbe26811" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:27 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26d3d2f-493a-41ab-a96c-ca504acf2774]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:28 devstack sudo[103072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811
Jul 07 22:54:28 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:28 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811" returned: 0 in 0.756s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:28 devstack sudo[103077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811
Jul 07 22:54:28 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:29 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-acf3d995-100a-4769-8983-66fcfbe26811" returned: 0 in 0.655s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-acf3d995-100a-4769-8983-66fcfbe26811" released by "delete_volume" :: held 1.454s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:29 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Created reservations ['b414813a-3b7a-4f72-b711-5f82b3a4f073', '2f72b549-3c89-435e-93c8-cc46bc0d58dc', '2f83126a-c65b-4264-8f6f-0c8793382422', 'ec3187b4-4789-4bba-b458-760432628b63'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:54:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:29 devstack sudo[103080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:54:29 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-45258a9f-629e-4311-9f03-896e895767b5-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-45258a9f-629e-4311-9f03-896e895767b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:30 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-45258a9f-629e-4311-9f03-896e895767b5" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.693s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:54:30 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Deleted volume successfully.
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-45258a9f-629e-4311-9f03-896e895767b5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Deleting offline snapshot 45258a9f-629e-4311-9f03-896e895767b5 of volume e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] snapshot_file for this snap is: volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[21735311-78db-4240-86d3-112ae669e0cd]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-71032ab5-ffa7-4931-96fd-68c87e111311 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-acf3d995-100a-4769-8983-66fcfbe26811-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:30 devstack sudo[103083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5
Jul 07 22:54:30 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:30 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5" returned: 0 in 0.718s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9d83fc-abcc-4f3e-b950-39b1b7c0ec93]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:31 devstack sudo[103089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9
Jul 07 22:54:31 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:31 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" returned: 0 in 0.770s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:31 devstack sudo[103094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5
Jul 07 22:54:31 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:32 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5" returned: 0 in 0.793s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:32 devstack sudo[103099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5
Jul 07 22:54:32 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:33 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9.45258a9f-629e-4311-9f03-896e895767b5" returned: 0 in 0.695s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-45258a9f-629e-4311-9f03-896e895767b5" released by "_delete_snapshot" :: held 3.075s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" released by "delete_snapshot" :: held 3.102s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:33 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Created reservations ['a303d174-7838-44c0-9d91-904e325b6082', '2f6ab9dc-3cf6-452a-ae23-e1f2c52fc590', 'f7ebb37a-c347-4579-b1dd-abedb3f08d52', 'ee283609-742b-4c6d-b7e4-5573ec18bc38'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:54:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Delete snapshot completed successfully.
Jul 07 22:54:33 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48bf03ad-1808-41e8-ad7f-4f2533c2a7e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-45258a9f-629e-4311-9f03-896e895767b5-delete_snapshot" released by "delete_snapshot" :: held 3.239s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-e11446b4-b162-4ebe-932a-1f7a5c49a8b9-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-e11446b4-b162-4ebe-932a-1f7a5c49a8b9-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:34 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cda3e6-54dd-407e-913f-53ea1279c499]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:34 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9
Jul 07 22:54:34 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:35 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" returned: 0 in 0.740s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:35 devstack sudo[103108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9
Jul 07 22:54:35 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:35 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" returned: 0 in 0.624s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-e11446b4-b162-4ebe-932a-1f7a5c49a8b9" released by "delete_volume" :: held 1.423s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:36 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Created reservations ['3e9a6e3e-d4e5-4d4c-95eb-c2d06f5105c0', '399f2155-adc9-4904-8bc2-0bf895b28db2', '8e3f695b-b2bb-452c-a7c5-591f2284f473', 'c6a943d8-720b-4afc-820f-30fbbd3d16dd'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:54:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:36 devstack sudo[103111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:54:36 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:36 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.638s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:36 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:54:36 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Deleted volume successfully.
Jul 07 22:54:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-a254257f-fa28-4a35-a03e-9f1f26ae3808 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-e11446b4-b162-4ebe-932a-1f7a5c49a8b9-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Flow 'volume_create_manager' (352156c6-e5cb-4fc3-9fd6-a6eedcaabfcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf42d1a-bb1f-4bc1-ac3f-9c06701303d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf42d1a-bb1f-4bc1-ac3f-9c06701303d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-336279165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a4f1d6-2c18-4402-8242-165bcce5d7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7710a1f2abe742a497467a2c4d9be43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:37Z,use_quota=True,user_id='f2f8ebec41634e55b03252eb06c8d573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3da7788-d2f3-43b0-bf9c-0618c83e9c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3da7788-d2f3-43b0-bf9c-0618c83e9c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262a4c6f-bb51-4a57-ad74-c68a79e5ced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262a4c6f-bb51-4a57-ad74-c68a79e5ced1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32a4f1d6-2c18-4402-8242-165bcce5d7c1', 'volume_name': 'volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b2d3b2-b342-4cfa-aad4-0c1bbd6fa4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91b2d3b2-b342-4cfa-aad4-0c1bbd6fa4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68ba7b5-1ae5-45cc-940f-13df288e43c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:37 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Volume 32a4f1d6-2c18-4402-8242-165bcce5d7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1', 'volume_size': 1}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-336279165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32a4f1d6-2c18-4402-8242-165bcce5d7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7710a1f2abe742a497467a2c4d9be43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:37Z,use_quota=True,user_id='f2f8ebec41634e55b03252eb06c8d573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Creating volume 32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:54:37 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:54:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:37 devstack sudo[103114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 1073741824
Jul 07 22:54:37 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:38 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 1073741824" returned: 0 in 0.843s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:38 devstack sudo[103120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1
Jul 07 22:54:38 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:38 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1" returned: 0 in 0.678s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:54:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b68ba7b5-1ae5-45cc-940f-13df288e43c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d39c1b-103a-4a06-89c9-c4f5d1b9b358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:38 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Volume volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 (32a4f1d6-2c18-4402-8242-165bcce5d7c1): created successfully
Jul 07 22:54:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d39c1b-103a-4a06-89c9-c4f5d1b9b358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:38 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Flow 'volume_create_manager' (352156c6-e5cb-4fc3-9fd6-a6eedcaabfcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:54:38 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-2738f3ca-4064-40ac-9bd1-0572660ad3c4 tempest-VolumesSnapshotTestJSON-741309696 None] Created volume successfully.
Jul 07 22:54:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Creating offline snapshot e2fafdd9-64cd-4098-991f-3f26465dedb6 of volume 32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:54:39 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2ee07c-8745-4d91-86f9-5e58889ee176]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:39 devstack sudo[103123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1
Jul 07 22:54:39 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:40 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1" returned: 0 in 0.784s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:40 devstack sudo[103128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 1G
Jul 07 22:54:40 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:41 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 1G" returned: 0 in 0.852s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:41 devstack sudo[103134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6
Jul 07 22:54:41 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:41 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6" returned: 0 in 0.704s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:41 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 is being set with open permissions: ugo+rw
Jul 07 22:54:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:41 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6
Jul 07 22:54:41 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:42 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6" returned: 0 in 0.678s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:42 devstack sudo[103142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.info
Jul 07 22:54:42 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:43 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.info" returned: 0 in 0.683s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:43 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.info is being set with open permissions: ugo+rw
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:43 devstack sudo[103145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.info
Jul 07 22:54:43 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:43 devstack sudo[103147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:54:43 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:43 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.info" returned: 0 in 0.692s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.486s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b1e47e81-0c1b-4ef0-b71d-3f71fbb6d489 tempest-VolumesSnapshotTestJSON-741309696 None] Create snapshot completed successfully
Jul 07 22:54:44 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.623s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:54:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:54:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:54:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Flow 'volume_create_manager' (97c9fbe5-1c6b-4254-b329-cbd95d7f75f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4cb2853-2621-41c6-a78d-65377bd5058d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4cb2853-2621-41c6-a78d-65377bd5058d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-757567835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b07119b-866e-4e1e-9dc4-816d39dc261e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7710a1f2abe742a497467a2c4d9be43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e2fafdd9-64cd-4098-991f-3f26465dedb6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:54:45Z,use_quota=True,user_id='f2f8ebec41634e55b03252eb06c8d573',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aad0aed-71e8-430c-98e1-ef5f31a025e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aad0aed-71e8-430c-98e1-ef5f31a025e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9735ace-11d1-4349-94ea-4a9bad133097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9735ace-11d1-4349-94ea-4a9bad133097) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b07119b-866e-4e1e-9dc4-816d39dc261e', 'volume_name': 'volume-9b07119b-866e-4e1e-9dc4-816d39dc261e', 'volume_size': 1, 'snapshot_id': 'e2fafdd9-64cd-4098-991f-3f26465dedb6'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd43d05-f262-4597-91cc-7ca51d33bc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd43d05-f262-4597-91cc-7ca51d33bc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c776855-9ddb-4bf7-9ba6-0fcbf61df7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:45 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Volume 9b07119b-866e-4e1e-9dc4-816d39dc261e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b07119b-866e-4e1e-9dc4-816d39dc261e', 'volume_size': 1, 'snapshot_id': 'e2fafdd9-64cd-4098-991f-3f26465dedb6'}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-e2fafdd9-64cd-4098-991f-3f26465dedb6-9b07119b-866e-4e1e-9dc4-816d39dc261e" by "_create_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-e2fafdd9-64cd-4098-991f-3f26465dedb6-9b07119b-866e-4e1e-9dc4-816d39dc261e" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Creating volume 9b07119b-866e-4e1e-9dc4-816d39dc261e from snapshot e2fafdd9-64cd-4098-991f-3f26465dedb6 {{(pid=88077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-9b07119b-866e-4e1e-9dc4-816d39dc261e" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-9b07119b-866e-4e1e-9dc4-816d39dc261e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] snapshot: e2fafdd9-64cd-4098-991f-3f26465dedb6, volume: 9b07119b-866e-4e1e-9dc4-816d39dc261e,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5669ce9a-7f40-4bad-88e1-de007ba5cdd9]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:45 devstack sudo[103157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6
Jul 07 22:54:45 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:46 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6" returned: 0 in 0.764s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:54:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:54:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:54:46 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd88451c-c69c-42df-888d-13e0479bcff2]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:46 devstack sudo[103162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1
Jul 07 22:54:46 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:46 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1" returned: 0 in 0.824s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:46 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:54:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:46 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e
Jul 07 22:54:46 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:51 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e" returned: 0 in 4.321s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:51 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4624fda-622c-48e9-8b2e-38b10d649ee9]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:51 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1
Jul 07 22:54:51 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:52 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1" returned: 0 in 0.950s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:52 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1, size 1024.00 MB, duration 4.32 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:54:52 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Converted 1024.00 MB image at 236.92 MB/s
Jul 07 22:54:52 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e is being set with open permissions: ugo+rw
Jul 07 22:54:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:52 devstack sudo[103186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e
Jul 07 22:54:52 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:52 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e" returned: 0 in 0.700s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-9b07119b-866e-4e1e-9dc4-816d39dc261e" released by "_copy_volume_from_snapshot" :: held 7.654s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-e2fafdd9-64cd-4098-991f-3f26465dedb6-9b07119b-866e-4e1e-9dc4-816d39dc261e" released by "_create_volume_from_snapshot" :: held 7.688s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.702s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c776855-9ddb-4bf7-9ba6-0fcbf61df7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b07119b-866e-4e1e-9dc4-816d39dc261e', 'volume_size': 1, 'snapshot_id': 'e2fafdd9-64cd-4098-991f-3f26465dedb6'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6dd9e7d-aac2-4a82-b316-c88b7d6a4f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:54:53 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Volume volume-9b07119b-866e-4e1e-9dc4-816d39dc261e (9b07119b-866e-4e1e-9dc4-816d39dc261e): created successfully
Jul 07 22:54:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6dd9e7d-aac2-4a82-b316-c88b7d6a4f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:54:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Flow 'volume_create_manager' (97c9fbe5-1c6b-4254-b329-cbd95d7f75f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:54:53 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-586268b8-c76c-4d41-892d-0f5f8197c3e2 tempest-VolumesSnapshotTestJSON-741309696 None] Created volume successfully.
Jul 07 22:54:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-9b07119b-866e-4e1e-9dc4-816d39dc261e-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-9b07119b-866e-4e1e-9dc4-816d39dc261e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-9b07119b-866e-4e1e-9dc4-816d39dc261e" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-9b07119b-866e-4e1e-9dc4-816d39dc261e" acquired by "delete_volume" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:53 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6304ecdb-8341-4b18-97f8-c899c93a9656]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:54 devstack sudo[103189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e
Jul 07 22:54:54 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:54 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e" returned: 0 in 0.775s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:54 devstack sudo[103194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e
Jul 07 22:54:54 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:55 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9b07119b-866e-4e1e-9dc4-816d39dc261e" returned: 0 in 0.658s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-9b07119b-866e-4e1e-9dc4-816d39dc261e" released by "delete_volume" :: held 1.472s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:55 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Created reservations ['83c5f31a-498a-4f0b-beba-7d90a17aad26', '295aeff5-aba5-47c1-911b-b54297722d8b', 'aa459a47-e58d-4c80-875b-d42178e6e3d6', '8b1c0b41-9aed-43c6-9ada-3ecdbfe729ff'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:54:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:55 devstack sudo[103197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:54:55 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-e2fafdd9-64cd-4098-991f-3f26465dedb6-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-e2fafdd9-64cd-4098-991f-3f26465dedb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-32a4f1d6-2c18-4402-8242-165bcce5d7c1" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:56 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.661s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:54:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Deleted volume successfully.
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-32a4f1d6-2c18-4402-8242-165bcce5d7c1" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-e2fafdd9-64cd-4098-991f-3f26465dedb6" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-e2fafdd9-64cd-4098-991f-3f26465dedb6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Deleting offline snapshot e2fafdd9-64cd-4098-991f-3f26465dedb6 of volume 32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] snapshot_file for this snap is: volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1ff23529-b126-4803-a6e0-1ca7af62a997 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-9b07119b-866e-4e1e-9dc4-816d39dc261e-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[97abd542-ac9f-4919-b007-9b2b05658eb6]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:56 devstack sudo[103200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6
Jul 07 22:54:56 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:57 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6" returned: 0 in 0.815s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:54:57 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d25e94f-6b51-4583-bed5-405c9e4d96ba]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:54:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:57 devstack sudo[103205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1
Jul 07 22:54:57 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:57 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1" returned: 0 in 0.751s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:57 devstack sudo[103210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6
Jul 07 22:54:57 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:58 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6" returned: 0 in 0.739s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:58 devstack sudo[103216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6
Jul 07 22:54:58 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:59 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1.e2fafdd9-64cd-4098-991f-3f26465dedb6" returned: 0 in 0.656s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:59 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=55,cinder:UPDATE=50,cinder:INSERT=16,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:54:59 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=54,cinder:UPDATE=56,cinder:INSERT=10,cinder:DELETE=9 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:54:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-e2fafdd9-64cd-4098-991f-3f26465dedb6" released by "_delete_snapshot" :: held 3.072s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-32a4f1d6-2c18-4402-8242-165bcce5d7c1" released by "delete_snapshot" :: held 3.103s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:59 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Created reservations ['cbd8d0c5-8090-491f-97cd-ec3ec0a658c5', 'd843f807-6a8a-4ed4-8294-f87fe185e633', 'bf9ee306-0408-4061-845e-c3db2a487b0a', '21c9bc13-59ed-4e82-b19b-4cf048612192'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:54:59 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Delete snapshot completed successfully.
Jul 07 22:54:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-619c8f3f-22b0-4e42-bcba-a5113f1caa22 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-e2fafdd9-64cd-4098-991f-3f26465dedb6-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-32a4f1d6-2c18-4402-8242-165bcce5d7c1-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-32a4f1d6-2c18-4402-8242-165bcce5d7c1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-32a4f1d6-2c18-4402-8242-165bcce5d7c1" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-32a4f1d6-2c18-4402-8242-165bcce5d7c1" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:00 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[40706fd1-c210-41ec-bd13-4d48fcd3b136]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:00 devstack sudo[103219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1
Jul 07 22:55:00 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:01 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1" returned: 0 in 0.779s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:01 devstack sudo[103556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1
Jul 07 22:55:01 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:01 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-32a4f1d6-2c18-4402-8242-165bcce5d7c1" returned: 0 in 0.649s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-32a4f1d6-2c18-4402-8242-165bcce5d7c1" released by "delete_volume" :: held 1.490s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Created reservations ['6e05e26e-7aa7-4d9c-af06-4cadde3110b5', 'c293bcf8-c69a-413c-829b-11a065e80f20', '6f012678-9570-482f-8a2f-c2eb97418ac8', '55b3211e-05c4-4c4e-bb40-0687430d4f00'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:02 devstack sudo[103562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:55:02 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-20c2ba36-8b06-44a5-8077-ecda2eddeef3-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-20c2ba36-8b06-44a5-8077-ecda2eddeef3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "cinder-quobyte-20c2ba36-8b06-44a5-8077-ecda2eddeef3" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-20c2ba36-8b06-44a5-8077-ecda2eddeef3" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:02 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.748s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:55:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Deleted volume successfully.
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ae379b-d20d-4897-9682-ec65c34a0f60]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-72ca3243-10df-4260-b38d-df21c816d074 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-32a4f1d6-2c18-4402-8242-165bcce5d7c1-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:02 devstack sudo[103565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3
Jul 07 22:55:02 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:03 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3" returned: 0 in 0.719s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:03 devstack sudo[103570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3
Jul 07 22:55:03 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:04 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-20c2ba36-8b06-44a5-8077-ecda2eddeef3" returned: 0 in 0.665s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-quobyte-20c2ba36-8b06-44a5-8077-ecda2eddeef3" released by "delete_volume" :: held 1.452s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Created reservations ['7ad277ea-ef6b-47fb-bad1-a1c84a90f908', '813c37ab-8513-4eda-8377-c8de1b00253b', '84dde4e7-3599-4318-b46e-06234156f2af', '637c9147-56c2-4233-9aae-aad1bcc4dc9a'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:04 devstack sudo[103573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:55:04 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:04 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.623s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:04 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:55:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Deleted volume successfully.
Jul 07 22:55:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5af731b7-7c57-442e-8c44-d5109db13e05 tempest-VolumesSnapshotTestJSON-741309696 None] Lock "cinder-20c2ba36-8b06-44a5-8077-ecda2eddeef3-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Flow 'volume_create_manager' (ea7193dd-0003-4516-a449-10d8a8455237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1767c1-040d-4ec4-aebd-80e5b09642d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1767c1-040d-4ec4-aebd-80e5b09642d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1904978754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ce6309-4500-42a6-9bbb-894e56738ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e803a25b44b491da3b3bba1bb0cc424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:11Z,use_quota=True,user_id='5daab3bc44c149cd97f09f955dc1f455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b94b4b5-95c0-4dd3-a9c0-bdba366e1b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b94b4b5-95c0-4dd3-a9c0-bdba366e1b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a060f8d7-19d4-4ddb-97a3-b3d0f9ed2adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a060f8d7-19d4-4ddb-97a3-b3d0f9ed2adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9ce6309-4500-42a6-9bbb-894e56738ac2', 'volume_name': 'volume-e9ce6309-4500-42a6-9bbb-894e56738ac2', 'volume_size': 2}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3382e8b-c659-4945-a27a-39a73521443d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3382e8b-c659-4945-a27a-39a73521443d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82667c1-a1df-44f4-ac7f-0214303bd13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:10 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Volume e9ce6309-4500-42a6-9bbb-894e56738ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9ce6309-4500-42a6-9bbb-894e56738ac2', 'volume_size': 2}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1904978754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ce6309-4500-42a6-9bbb-894e56738ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e803a25b44b491da3b3bba1bb0cc424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:11Z,use_quota=True,user_id='5daab3bc44c149cd97f09f955dc1f455',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Creating volume e9ce6309-4500-42a6-9bbb-894e56738ac2 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:55:10 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:55:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 2147483648 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:10 devstack sudo[103582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 2147483648
Jul 07 22:55:10 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:11 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 2147483648" returned: 0 in 0.942s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:11 devstack sudo[103588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2
Jul 07 22:55:11 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:12 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2" returned: 0 in 0.644s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82667c1-a1df-44f4-ac7f-0214303bd13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ce6309-4500-42a6-9bbb-894e56738ac2', 'volume_size': 2}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56f9c7f-f95e-4d74-a89b-3098d95fed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:12 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Volume volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 (e9ce6309-4500-42a6-9bbb-894e56738ac2): created successfully
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56f9c7f-f95e-4d74-a89b-3098d95fed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Flow 'volume_create_manager' (ea7193dd-0003-4516-a449-10d8a8455237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:55:12 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-23045c53-4578-4902-a3e3-45b4e558eb89 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Created volume successfully.
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Creating offline snapshot 92a72a95-4a1f-4b95-818e-672b5fb840d8 of volume e9ce6309-4500-42a6-9bbb-894e56738ac2 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0033bb61-9b2f-4d40-82f3-76abfcd7c61f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:13 devstack sudo[103592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2
Jul 07 22:55:13 devstack sudo[103592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:13 devstack sudo[103592]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2" returned: 0 in 0.730s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8 2G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:13 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8 2G
Jul 07 22:55:13 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:14 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8 2G" returned: 0 in 0.785s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:14 devstack sudo[103602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8
Jul 07 22:55:14 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:15 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8" returned: 0 in 0.694s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:15 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8 is being set with open permissions: ugo+rw
Jul 07 22:55:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:15 devstack sudo[103607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8
Jul 07 22:55:15 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:15 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8" returned: 0 in 0.653s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:15 devstack sudo[103612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.info
Jul 07 22:55:15 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:16 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.info" returned: 0 in 0.673s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:16 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.info is being set with open permissions: ugo+rw
Jul 07 22:55:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:16 devstack sudo[103615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.info
Jul 07 22:55:16 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:17 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.info" returned: 0 in 0.651s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.274s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:17 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-79d5fe4b-84e6-4a90-b33c-b280123d779f tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Create snapshot completed successfully
Jul 07 22:55:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Acquiring lock "cinder-92a72a95-4a1f-4b95-818e-672b5fb840d8-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "cinder-92a72a95-4a1f-4b95-818e-672b5fb840d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Acquiring lock "cinder-quobyte-e9ce6309-4500-42a6-9bbb-894e56738ac2" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "cinder-quobyte-e9ce6309-4500-42a6-9bbb-894e56738ac2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Acquiring lock "cinder-quobyte-92a72a95-4a1f-4b95-818e-672b5fb840d8" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "cinder-quobyte-92a72a95-4a1f-4b95-818e-672b5fb840d8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Deleting offline snapshot 92a72a95-4a1f-4b95-818e-672b5fb840d8 of volume e9ce6309-4500-42a6-9bbb-894e56738ac2 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:55:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] snapshot_file for this snap is: volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:55:18 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fc428a-52dd-484f-86ae-23c96538d8b5]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:18 devstack sudo[103618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8
Jul 07 22:55:18 devstack sudo[103618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:19 devstack sudo[103618]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8" returned: 0 in 0.827s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9ce6309-4500-42a6-9bbb-894e56738ac2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:55:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[99136314-2810-44fa-b3a9-154bce2a78aa]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:19 devstack sudo[103624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2
Jul 07 22:55:19 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:20 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2" returned: 0 in 0.808s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:20 devstack sudo[103629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8
Jul 07 22:55:20 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:20 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8" returned: 0 in 0.764s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:20 devstack sudo[103635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8
Jul 07 22:55:20 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:21 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2.92a72a95-4a1f-4b95-818e-672b5fb840d8" returned: 0 in 0.646s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "cinder-quobyte-92a72a95-4a1f-4b95-818e-672b5fb840d8" released by "_delete_snapshot" :: held 3.149s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "cinder-quobyte-e9ce6309-4500-42a6-9bbb-894e56738ac2" released by "delete_snapshot" :: held 3.181s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:21 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Created reservations ['24ef9f26-f7c4-41c0-9b03-1d50cd6c2f0b', '9431c738-9db1-472b-9aae-8f2db4bf0aa2', 'd1c96592-7738-4a2f-8a2e-590ad6e8724a', 'eac2792f-7333-44c7-9229-76c806fcc1f1'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:55:21 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Delete snapshot completed successfully.
Jul 07 22:55:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-182c9a2b-3a00-42f3-b7df-93e676deae9a tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "cinder-92a72a95-4a1f-4b95-818e-672b5fb840d8-delete_snapshot" released by "delete_snapshot" :: held 3.411s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Acquiring lock "cinder-e9ce6309-4500-42a6-9bbb-894e56738ac2-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "cinder-e9ce6309-4500-42a6-9bbb-894e56738ac2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Acquiring lock "cinder-quobyte-e9ce6309-4500-42a6-9bbb-894e56738ac2" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "cinder-quobyte-e9ce6309-4500-42a6-9bbb-894e56738ac2" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c9c87c-af47-4b4a-80dd-bdb4c039ceb3]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:22 devstack sudo[103760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2
Jul 07 22:55:22 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:23 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2" returned: 0 in 0.769s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:23 devstack sudo[103765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2
Jul 07 22:55:23 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:24 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e9ce6309-4500-42a6-9bbb-894e56738ac2" returned: 0 in 0.670s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "cinder-quobyte-e9ce6309-4500-42a6-9bbb-894e56738ac2" released by "delete_volume" :: held 1.494s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Created reservations ['dc3a6dda-4c9d-4347-8c89-4f35d001f180', '5fdf9e17-69c6-4b95-b34c-ea2c435b52d4', '64f91545-eab5-4e39-8f64-d02005474d64', '878c4bfd-abf6-4c55-95fd-9f83dc6afe6d'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:24 devstack sudo[103768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:55:24 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:24 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.702s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:24 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:55:25 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Deleted volume successfully.
Jul 07 22:55:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f0f97c24-728e-4401-8339-6e53c10c10f9 tempest-VolumesSnapshotNegativeTestJSON-395747973 None] Lock "cinder-e9ce6309-4500-42a6-9bbb-894e56738ac2-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:34 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=28,cinder:INSERT=10,cinder:UPDATE=44,cinder:DELETE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:55:35 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=34,cinder:INSERT=12,cinder:UPDATE=36,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:55:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:55:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:43 devstack sudo[103774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:55:43 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:44 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.693s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:55:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:55:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:55:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Flow 'volume_create_manager' (1f974d86-26ec-48b0-830d-0110950f80a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e4882d-fc3d-4d6e-8ca0-5d91c48bf5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75e4882d-fc3d-4d6e-8ca0-5d91c48bf5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-381602953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c3590a-473f-4533-ba8d-0f26b24381a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682f20789c9c41d58ab4b8d4efde0414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:50Z,use_quota=True,user_id='8d26f54fb08a42389c6aae150f420160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(241a193b-85f7-4f6a-969f-e2b81e91fb5b),volume_type_id=241a193b-85f7-4f6a-969f-e2b81e91fb5b)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ec342f-897a-48b9-8018-8ecad7e5ca75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ec342f-897a-48b9-8018-8ecad7e5ca75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9fb269-cfba-4830-9cc1-cfaee4bf8576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9fb269-cfba-4830-9cc1-cfaee4bf8576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c3590a-473f-4533-ba8d-0f26b24381a4', 'volume_name': 'volume-97c3590a-473f-4533-ba8d-0f26b24381a4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b39388c-b372-4fb5-93a9-f545e072fd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b39388c-b372-4fb5-93a9-f545e072fd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659555aa-e6f3-4ad9-bf2e-39a8df6a6e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:49 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Volume 97c3590a-473f-4533-ba8d-0f26b24381a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c3590a-473f-4533-ba8d-0f26b24381a4', 'volume_size': 1}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-381602953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c3590a-473f-4533-ba8d-0f26b24381a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682f20789c9c41d58ab4b8d4efde0414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:50Z,use_quota=True,user_id='8d26f54fb08a42389c6aae150f420160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(241a193b-85f7-4f6a-969f-e2b81e91fb5b),volume_type_id=241a193b-85f7-4f6a-969f-e2b81e91fb5b)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Creating volume 97c3590a-473f-4533-ba8d-0f26b24381a4 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:55:49 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:55:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:49 devstack sudo[103783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4 1073741824
Jul 07 22:55:49 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Flow 'volume_create_manager' (51d8c00c-e457-4a26-935d-bbd7e2f74a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372a5969-ddae-4722-9fb8-e2a3a2c419b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372a5969-ddae-4722-9fb8-e2a3a2c419b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-651938366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45935ea2-aae0-49e3-8989-ba37520611a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682f20789c9c41d58ab4b8d4efde0414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:50Z,use_quota=True,user_id='8d26f54fb08a42389c6aae150f420160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c43f5da-b005-46ba-b0c4-f7a3ab46e127),volume_type_id=7c43f5da-b005-46ba-b0c4-f7a3ab46e127)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e203eb8-899b-413d-8d15-00b1db1ead50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e203eb8-899b-413d-8d15-00b1db1ead50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5feeb156-8c72-4e42-8928-56568eedf799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5feeb156-8c72-4e42-8928-56568eedf799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45935ea2-aae0-49e3-8989-ba37520611a4', 'volume_name': 'volume-45935ea2-aae0-49e3-8989-ba37520611a4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c634763-fe8e-42ec-aa5e-813410a45e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c634763-fe8e-42ec-aa5e-813410a45e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17d884f-144f-433f-8362-25b0bf8ce0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:50 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Volume 45935ea2-aae0-49e3-8989-ba37520611a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45935ea2-aae0-49e3-8989-ba37520611a4', 'volume_size': 1}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Flow 'volume_create_manager' (d0ada9eb-c6ff-4890-8128-3c081d9228de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b7048d-2ac9-4636-bf0b-4b13a8f5dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b7048d-2ac9-4636-bf0b-4b13a8f5dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1783098323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fdcaf1-e8bb-435b-bd93-62167d3af158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682f20789c9c41d58ab4b8d4efde0414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:51Z,use_quota=True,user_id='8d26f54fb08a42389c6aae150f420160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08cf4fac-b1fc-4e4b-88d9-bb0265ad2919),volume_type_id=08cf4fac-b1fc-4e4b-88d9-bb0265ad2919)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe1a93f-e567-4085-9f19-bc08705576c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffe1a93f-e567-4085-9f19-bc08705576c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99458b93-28f0-41d4-b545-eb19464ef6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG cinder.image.glance [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Creating Keystone auth plugin from conf {{(pid=88077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:55:50 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4 1073741824" returned: 0 in 0.993s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:50 devstack sudo[103790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4
Jul 07 22:55:50 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99458b93-28f0-41d4-b545-eb19464ef6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f6fdcaf1-e8bb-435b-bd93-62167d3af158', 'volume_name': 'volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158', 'volume_size': 1, 'image_id': 'cf564644-778c-4234-81a6-d1edc9274b41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf564644-778c-4234-81a6-d1edc9274b41', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1874962533', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '682f20789c9c41d58ab4b8d4efde0414', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf564644-778c-4234-81a6-d1edc9274b41', 'created_at': datetime.datetime(2026, 7, 7, 20, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf564644-778c-4234-81a6-d1edc9274b41/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad688c2a80>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a0fb8a-26de-4bea-93cb-4be9396cfa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a0fb8a-26de-4bea-93cb-4be9396cfa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd51bc3-0e90-4b98-b5ee-4cf5a5729d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:51 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Volume f6fdcaf1-e8bb-435b-bd93-62167d3af158: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158', 'volume_size': 1, 'image_id': 'cf564644-778c-4234-81a6-d1edc9274b41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf564644-778c-4234-81a6-d1edc9274b41', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1874962533', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '682f20789c9c41d58ab4b8d4efde0414', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf564644-778c-4234-81a6-d1edc9274b41', 'created_at': datetime.datetime(2026, 7, 7, 20, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf564644-778c-4234-81a6-d1edc9274b41/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad688c2a80>}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Trying to clone f6fdcaf1-e8bb-435b-bd93-62167d3af158 from image cf564644-778c-4234-81a6-d1edc9274b41 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cf564644-778c-4234-81a6-d1edc9274b41', 'metadata': {}}]). {{(pid=88077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:55:51 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4" returned: 0 in 0.762s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-651938366',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45935ea2-aae0-49e3-8989-ba37520611a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682f20789c9c41d58ab4b8d4efde0414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:50Z,use_quota=True,user_id='8d26f54fb08a42389c6aae150f420160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c43f5da-b005-46ba-b0c4-f7a3ab46e127),volume_type_id=7c43f5da-b005-46ba-b0c4-f7a3ab46e127)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Creating volume 45935ea2-aae0-49e3-8989-ba37520611a4 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:55:51 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:51 devstack sudo[103793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4 1073741824
Jul 07 22:55:51 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659555aa-e6f3-4ad9-bf2e-39a8df6a6e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c3590a-473f-4533-ba8d-0f26b24381a4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4d1c9a-fa48-4694-8e4b-3b721ec07968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:51 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Volume volume-97c3590a-473f-4533-ba8d-0f26b24381a4 (97c3590a-473f-4533-ba8d-0f26b24381a4): created successfully
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf4d1c9a-fa48-4694-8e4b-3b721ec07968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Flow 'volume_create_manager' (1f974d86-26ec-48b0-830d-0110950f80a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:55:51 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ef4a70b5-6d14-4636-913b-e3444de216d0 tempest-TestInstancesWithCinderVolumes-438090662 None] Created volume successfully.
Jul 07 22:55:52 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4 1073741824" returned: 0 in 0.931s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:52 devstack sudo[103799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4
Jul 07 22:55:52 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:53 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4" returned: 0 in 0.649s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:55:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d17d884f-144f-433f-8362-25b0bf8ce0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45935ea2-aae0-49e3-8989-ba37520611a4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944588f4-8eab-41d6-8c31-5aa2d135e65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:53 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Volume volume-45935ea2-aae0-49e3-8989-ba37520611a4 (45935ea2-aae0-49e3-8989-ba37520611a4): created successfully
Jul 07 22:55:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944588f4-8eab-41d6-8c31-5aa2d135e65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Flow 'volume_create_manager' (51d8c00c-e457-4a26-935d-bbd7e2f74a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:55:53 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-48e36082-c3fc-46cd-a20f-35b17904f3a1 tempest-TestInstancesWithCinderVolumes-438090662 None] Created volume successfully.
Jul 07 22:55:54 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD, size 20.69 MB, duration 3.11 sec {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:55:54 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Image download 20.69 MB at 6.65 MB/s
Jul 07 22:55:54 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[baac21e6-6537-4225-b541-8c4cb7cd0071]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:54 devstack sudo[103802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD
Jul 07 22:55:54 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:54 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Temporary image cf564644-778c-4234-81a6-d1edc9274b41 is fetched for user 8d26f54fb08a42389c6aae150f420160. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e6ac52-0945-4dd7-b76b-61943e459600]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:55 devstack sudo[103807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD
Jul 07 22:55:55 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:55 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD" returned: 0 in 0.803s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1783098323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6fdcaf1-e8bb-435b-bd93-62167d3af158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='682f20789c9c41d58ab4b8d4efde0414',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:51Z,use_quota=True,user_id='8d26f54fb08a42389c6aae150f420160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08cf4fac-b1fc-4e4b-88d9-bb0265ad2919),volume_type_id=08cf4fac-b1fc-4e4b-88d9-bb0265ad2919)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Creating volume f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:55:55 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:55:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:55 devstack sudo[103812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 1073741824
Jul 07 22:55:55 devstack sudo[103812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:56 devstack sudo[103812]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 1073741824" returned: 0 in 0.952s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:56 devstack sudo[103817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158
Jul 07 22:55:56 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:57 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158" returned: 0 in 0.650s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:55:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:57 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Attempting download of cf564644-778c-4234-81a6-d1edc9274b41 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf564644-778c-4234-81a6-d1edc9274b41', 'metadata': {}}])) to volume f6fdcaf1-e8bb-435b-bd93-62167d3af158. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:55:57 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2485120a-e54e-4a22-9d9e-5fc49112fd55]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf564644-778c-4234-81a6-d1edc9274b41_q_8qodvl {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:57 devstack sudo[103820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf564644-778c-4234-81a6-d1edc9274b41_q_8qodvl
Jul 07 22:55:57 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:58 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cf564644-778c-4234-81a6-d1edc9274b41_q_8qodvl" returned: 0 in 0.729s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf564644-778c-4234-81a6-d1edc9274b41_q_8qodvl {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:58 devstack sudo[103824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf564644-778c-4234-81a6-d1edc9274b41_q_8qodvl
Jul 07 22:55:58 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:59 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf564644-778c-4234-81a6-d1edc9274b41_q_8qodvl" returned: 1 in 0.775s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cf564644-778c-4234-81a6-d1edc9274b41_q_8qodvl' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:55:59 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[121f80a0-4f2e-4db8-b9fe-77a7751e9acc]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:59 devstack sudo[103828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD
Jul 07 22:55:59 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:59 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD" returned: 0 in 0.756s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:59 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] cf564644-778c-4234-81a6-d1edc9274b41 was qcow2, converting to raw {{(pid=88077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:55:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:59 devstack sudo[103833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158
Jul 07 22:55:59 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:01 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158" returned: 0 in 1.841s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:01 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cf564644-778c-4234-81a6-d1edc9274b41_0po4fwvwdevstack@QuobyteHD, size 112.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:56:01 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Converted 112.00 MB image at 60.80 MB/s
Jul 07 22:56:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:01 devstack sudo[103843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 1G
Jul 07 22:56:01 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:02 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 1G" returned: 0 in 0.739s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9674840-acf5-49c8-82f8-3a48b59d52bf]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:56:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:02 devstack sudo[103848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158
Jul 07 22:56:02 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:03 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158" returned: 0 in 0.725s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:03 devstack sudo[103852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158
Jul 07 22:56:03 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:03 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158" returned: 1 in 0.722s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:56:03 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Downloaded image cf564644-778c-4234-81a6-d1edc9274b41 ((None, [{'url': 'file:///opt/stack/data/glance/images/cf564644-778c-4234-81a6-d1edc9274b41', 'metadata': {}}])) to volume f6fdcaf1-e8bb-435b-bd93-62167d3af158 successfully. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:56:03 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Temporary image cf564644-778c-4234-81a6-d1edc9274b41 for user 8d26f54fb08a42389c6aae150f420160 is deleted. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:56:03 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Marking volume f6fdcaf1-e8bb-435b-bd93-62167d3af158 as bootable. {{(pid=88077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:56:03 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Copying metadata from image cf564644-778c-4234-81a6-d1edc9274b41 to f6fdcaf1-e8bb-435b-bd93-62167d3af158. {{(pid=88077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:56:03 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Creating volume glance metadata for volume f6fdcaf1-e8bb-435b-bd93-62167d3af158 backed by image cf564644-778c-4234-81a6-d1edc9274b41 with: {'image_id': 'cf564644-778c-4234-81a6-d1edc9274b41', 'image_name': 'tempest-scenario-img--1874962533', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:56:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd51bc3-0e90-4b98-b5ee-4cf5a5729d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158', 'volume_size': 1, 'image_id': 'cf564644-778c-4234-81a6-d1edc9274b41', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cf564644-778c-4234-81a6-d1edc9274b41', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1874962533', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '682f20789c9c41d58ab4b8d4efde0414', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cf564644-778c-4234-81a6-d1edc9274b41', 'created_at': datetime.datetime(2026, 7, 7, 20, 55, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 55, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cf564644-778c-4234-81a6-d1edc9274b41/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad688c2a80>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:56:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86d8896-bd5a-458b-84e8-8c86b38fc08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:56:04 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Volume volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 (f6fdcaf1-e8bb-435b-bd93-62167d3af158): created successfully
Jul 07 22:56:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a86d8896-bd5a-458b-84e8-8c86b38fc08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:56:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Flow 'volume_create_manager' (d0ada9eb-c6ff-4890-8128-3c081d9228de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:56:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-adb5e8f9-7d20-4371-9452-5d55e3239968 tempest-TestInstancesWithCinderVolumes-438090662 None] Created volume successfully.
Jul 07 22:56:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-e1e54855-1028-4227-a533-fc8277c098f8 req-1a909b64-94cb-4479-9097-b81f656d7e60 tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:56:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-e1e54855-1028-4227-a533-fc8277c098f8 req-1a909b64-94cb-4479-9097-b81f656d7e60 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:56:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f3975d-fa0d-4d7e-b24d-7425f8e02853]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:56:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-e1e54855-1028-4227-a533-fc8277c098f8 req-1a909b64-94cb-4479-9097-b81f656d7e60 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:11 devstack sudo[103870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158
Jul 07 22:56:11 devstack sudo[103870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:12 devstack sudo[103870]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-e1e54855-1028-4227-a533-fc8277c098f8 req-1a909b64-94cb-4479-9097-b81f656d7e60 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158" returned: 0 in 0.788s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-e1e54855-1028-4227-a533-fc8277c098f8 req-1a909b64-94cb-4479-9097-b81f656d7e60 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:12 devstack sudo[103875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158
Jul 07 22:56:12 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:13 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-e1e54855-1028-4227-a533-fc8277c098f8 req-1a909b64-94cb-4479-9097-b81f656d7e60 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158" returned: 1 in 0.917s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-e1e54855-1028-4227-a533-fc8277c098f8 req-1a909b64-94cb-4479-9097-b81f656d7e60 tempest-TestInstancesWithCinderVolumes-438090662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:56:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-e1e54855-1028-4227-a533-fc8277c098f8 req-1a909b64-94cb-4479-9097-b81f656d7e60 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.747s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:56:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-e1e54855-1028-4227-a533-fc8277c098f8 req-1a909b64-94cb-4479-9097-b81f656d7e60 tempest-TestInstancesWithCinderVolumes-438090662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69b0cb70-00aa-4cc1-8fe3-f0aa14eb4720', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:56:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-e1e54855-1028-4227-a533-fc8277c098f8 req-1a909b64-94cb-4479-9097-b81f656d7e60 tempest-TestInstancesWithCinderVolumes-438090662 None] attachment_update completed successfully.
Jul 07 22:56:23 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:56:23 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=16,cinder:UPDATE=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:56:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:56:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:56:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:56:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:56:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:56:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:56:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:43 devstack sudo[104481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:56:43 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:44 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.676s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:56:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:56:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:56:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:56:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-96852e1e-6d3f-4424-8ac1-11e37fa396d2 req-deef29ac-c8b6-43e6-abb1-a216531f75f5 tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:56:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-96852e1e-6d3f-4424-8ac1-11e37fa396d2 req-deef29ac-c8b6-43e6-abb1-a216531f75f5 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:56:46 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[71499523-f328-4086-865e-ec5dae0b5f50]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:56:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-96852e1e-6d3f-4424-8ac1-11e37fa396d2 req-deef29ac-c8b6-43e6-abb1-a216531f75f5 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:46 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4
Jul 07 22:56:46 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:47 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-96852e1e-6d3f-4424-8ac1-11e37fa396d2 req-deef29ac-c8b6-43e6-abb1-a216531f75f5 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4" returned: 0 in 0.771s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-96852e1e-6d3f-4424-8ac1-11e37fa396d2 req-deef29ac-c8b6-43e6-abb1-a216531f75f5 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.788s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:56:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-96852e1e-6d3f-4424-8ac1-11e37fa396d2 req-deef29ac-c8b6-43e6-abb1-a216531f75f5 tempest-TestInstancesWithCinderVolumes-438090662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-97c3590a-473f-4533-ba8d-0f26b24381a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f64cd5d4-156d-4038-88eb-3f2cd655a588', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:56:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-96852e1e-6d3f-4424-8ac1-11e37fa396d2 req-deef29ac-c8b6-43e6-abb1-a216531f75f5 tempest-TestInstancesWithCinderVolumes-438090662 None] attachment_update completed successfully.
Jul 07 22:56:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-31fce46d-159a-4eda-bea4-cb03bd01f44b req-4577c903-bb83-4cb2-8f2c-20b0031e9922 tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:56:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-31fce46d-159a-4eda-bea4-cb03bd01f44b req-4577c903-bb83-4cb2-8f2c-20b0031e9922 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:56:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9a3fad-8294-4e13-9cc4-ccc0b92b2191]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:56:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-31fce46d-159a-4eda-bea4-cb03bd01f44b req-4577c903-bb83-4cb2-8f2c-20b0031e9922 tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:55 devstack sudo[104526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4
Jul 07 22:56:55 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:56 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-31fce46d-159a-4eda-bea4-cb03bd01f44b req-4577c903-bb83-4cb2-8f2c-20b0031e9922 tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4" returned: 0 in 0.786s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-31fce46d-159a-4eda-bea4-cb03bd01f44b req-4577c903-bb83-4cb2-8f2c-20b0031e9922 tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.804s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:56:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-31fce46d-159a-4eda-bea4-cb03bd01f44b req-4577c903-bb83-4cb2-8f2c-20b0031e9922 tempest-TestInstancesWithCinderVolumes-438090662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-45935ea2-aae0-49e3-8989-ba37520611a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a88bd88-1da7-45e2-a6b3-e25ce679a348', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:56:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-31fce46d-159a-4eda-bea4-cb03bd01f44b req-4577c903-bb83-4cb2-8f2c-20b0031e9922 tempest-TestInstancesWithCinderVolumes-438090662 None] attachment_update completed successfully.
Jul 07 22:57:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-c890dcff-76ed-4e4b-9050-2b5a2b39cbb1 req-37a12d2b-f4cb-4711-ba61-6d0dc313b81c tempest-TestInstancesWithCinderVolumes-438090662 None] Terminate volume connection completed successfully.
Jul 07 22:57:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-c890dcff-76ed-4e4b-9050-2b5a2b39cbb1 req-37a12d2b-f4cb-4711-ba61-6d0dc313b81c tempest-TestInstancesWithCinderVolumes-438090662 None] Deleting attachment f64cd5d4-156d-4038-88eb-3f2cd655a588. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:57:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "cinder-97c3590a-473f-4533-ba8d-0f26b24381a4-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:57:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-97c3590a-473f-4533-ba8d-0f26b24381a4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:57:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "cinder-quobyte-97c3590a-473f-4533-ba8d-0f26b24381a4" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:57:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-quobyte-97c3590a-473f-4533-ba8d-0f26b24381a4" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:57:07 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1d8a58-4dfc-4262-96e4-b0370503f480]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:57:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:07 devstack sudo[104568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4
Jul 07 22:57:07 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:07 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4" returned: 0 in 0.833s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:07 devstack sudo[104575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4
Jul 07 22:57:07 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:08 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-97c3590a-473f-4533-ba8d-0f26b24381a4" returned: 0 in 0.678s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-quobyte-97c3590a-473f-4533-ba8d-0f26b24381a4" released by "delete_volume" :: held 1.549s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:57:08 devstack cinder-volume[88077]: WARNING cinder.quota [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1387533360-180673101 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1387533360-180673101, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:57:08 devstack cinder-volume[88077]: WARNING cinder.quota [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1387533360-180673101 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1387533360-180673101, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:57:08 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Created reservations ['3f923757-579a-4f83-a36c-09ea00169c24', '4ce5637b-75b2-4a1b-a59d-e29e9dbdec57', 'ddb0cd59-6cbe-4e26-960f-ebf1318253fe', '07ad1fec-b64a-4d9f-9071-21005162e09a'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:57:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:57:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:57:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:57:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:08 devstack sudo[104578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:57:08 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:09 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.662s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:09 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:57:09 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Deleted volume successfully.
Jul 07 22:57:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-300d225b-9a09-44f1-a2a4-f52556928a9c tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-97c3590a-473f-4533-ba8d-0f26b24381a4-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:57:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-a61162ba-7245-4d6e-a38f-63565e1aed2b req-70c2cdc8-6f57-44cb-a158-9497d7f16da4 tempest-TestInstancesWithCinderVolumes-438090662 None] Terminate volume connection completed successfully.
Jul 07 22:57:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-a61162ba-7245-4d6e-a38f-63565e1aed2b req-70c2cdc8-6f57-44cb-a158-9497d7f16da4 tempest-TestInstancesWithCinderVolumes-438090662 None] Deleting attachment 7a88bd88-1da7-45e2-a6b3-e25ce679a348. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:57:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "cinder-45935ea2-aae0-49e3-8989-ba37520611a4-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:57:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-45935ea2-aae0-49e3-8989-ba37520611a4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:57:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "cinder-quobyte-45935ea2-aae0-49e3-8989-ba37520611a4" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:57:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-quobyte-45935ea2-aae0-49e3-8989-ba37520611a4" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:57:13 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be585e6-52b3-4011-a5be-303e94f79d86]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:57:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:13 devstack sudo[104605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4
Jul 07 22:57:13 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:14 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4" returned: 0 in 0.846s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:14 devstack sudo[104611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4
Jul 07 22:57:14 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:15 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-45935ea2-aae0-49e3-8989-ba37520611a4" returned: 0 in 0.754s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-quobyte-45935ea2-aae0-49e3-8989-ba37520611a4" released by "delete_volume" :: held 1.650s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:57:15 devstack cinder-volume[88077]: WARNING cinder.quota [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1645624671-1120413920 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1645624671-1120413920, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:57:15 devstack cinder-volume[88077]: WARNING cinder.quota [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1645624671-1120413920 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1645624671-1120413920, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:57:15 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Created reservations ['7b110fe6-d9e0-4f44-8107-18b58670a2e5', '8981039e-9d52-4b51-8462-6414d71bb29d', 'ebd94a42-98c1-4859-b852-bd6343510f3f', 'ba91b4c3-55cb-4952-a97f-88f545a61ed1'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:57:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:57:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:57:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:57:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:15 devstack sudo[104615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:57:15 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:16 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.765s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:16 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:57:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Deleted volume successfully.
Jul 07 22:57:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f07bbc54-2956-470f-88ad-8e137c41495d tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-45935ea2-aae0-49e3-8989-ba37520611a4-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:57:20 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-3996c937-1f13-4a80-b3f4-cf1e47319816 req-95bf40bc-6943-4ba7-b944-c6aaf69e9263 tempest-TestInstancesWithCinderVolumes-438090662 None] Terminate volume connection completed successfully.
Jul 07 22:57:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-3996c937-1f13-4a80-b3f4-cf1e47319816 req-95bf40bc-6943-4ba7-b944-c6aaf69e9263 tempest-TestInstancesWithCinderVolumes-438090662 None] Deleting attachment 69b0cb70-00aa-4cc1-8fe3-f0aa14eb4720. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:57:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "cinder-f6fdcaf1-e8bb-435b-bd93-62167d3af158-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:57:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-f6fdcaf1-e8bb-435b-bd93-62167d3af158-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:57:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "cinder-quobyte-f6fdcaf1-e8bb-435b-bd93-62167d3af158" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:57:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-quobyte-f6fdcaf1-e8bb-435b-bd93-62167d3af158" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:57:24 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c31180-9ed8-4bd2-abaf-34222eb40133]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:57:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:24 devstack sudo[104686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158
Jul 07 22:57:24 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:25 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158" returned: 0 in 0.761s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:25 devstack sudo[104690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158
Jul 07 22:57:25 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:26 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158" returned: 1 in 0.747s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:57:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:26 devstack sudo[104695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158
Jul 07 22:57:26 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:26 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f6fdcaf1-e8bb-435b-bd93-62167d3af158" returned: 0 in 0.645s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-quobyte-f6fdcaf1-e8bb-435b-bd93-62167d3af158" released by "delete_volume" :: held 2.230s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:57:26 devstack cinder-volume[88077]: WARNING cinder.quota [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-575754253-817291082 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-575754253-817291082, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:57:26 devstack cinder-volume[88077]: WARNING cinder.quota [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-575754253-817291082 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-575754253-817291082, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:57:27 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Created reservations ['83935c09-b020-4f66-aed4-d2c9e9ef1723', 'b8724205-ef11-48c3-9551-2a327c0410fe', 'c7e1fb79-bb5a-47dc-a714-453a81774135', '11b2ccb7-684c-4c5c-862a-922fdaeb229b'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:57:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:57:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:57:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:57:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:27 devstack sudo[104698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:57:27 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:27 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.692s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:27 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:57:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Deleted volume successfully.
Jul 07 22:57:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0f7d2f84-f85f-44e3-b743-d2284e2a9ecd tempest-TestInstancesWithCinderVolumes-438090662 None] Lock "cinder-f6fdcaf1-e8bb-435b-bd93-62167d3af158-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:57:37 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=31,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:57:37 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=28,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:57:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:57:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:57:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:57:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:57:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:43 devstack sudo[104708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:57:43 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:44 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.758s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:57:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:57:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:57:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Flow 'volume_create_manager' (7e4ed8d8-f089-4e6c-ab91-e7484b193ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903add1d-dcb4-4ec4-a06a-611128186553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903add1d-dcb4-4ec4-a06a-611128186553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-88750963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ab78a6-0edc-4ae4-a736-955691d57ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e98d60123c14b03a1da3f44d382ab0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:58:00Z,use_quota=True,user_id='a2e25f8e41564cd388f7d6723e90b422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e21049-a146-4e88-ae6e-5591b5cf396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e21049-a146-4e88-ae6e-5591b5cf396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c444e1-8fa4-423a-9279-d2d6776786cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24c444e1-8fa4-423a-9279-d2d6776786cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ab78a6-0edc-4ae4-a736-955691d57ec9', 'volume_name': 'volume-00ab78a6-0edc-4ae4-a736-955691d57ec9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59665c8e-692e-40e2-8914-9ffd8b530eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59665c8e-692e-40e2-8914-9ffd8b530eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82feaab-dae2-4847-b18a-7592a4471237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:59 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Volume 00ab78a6-0edc-4ae4-a736-955691d57ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ab78a6-0edc-4ae4-a736-955691d57ec9', 'volume_size': 1}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-88750963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ab78a6-0edc-4ae4-a736-955691d57ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e98d60123c14b03a1da3f44d382ab0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:58:00Z,use_quota=True,user_id='a2e25f8e41564cd388f7d6723e90b422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Creating volume 00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:57:59 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 22:57:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:59 devstack sudo[104719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 1073741824
Jul 07 22:57:59 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:00 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 1073741824" returned: 0 in 0.883s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:00 devstack sudo[104728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9
Jul 07 22:58:00 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:01 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9" returned: 0 in 0.654s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:58:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:58:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82feaab-dae2-4847-b18a-7592a4471237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ab78a6-0edc-4ae4-a736-955691d57ec9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:58:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9a16fe-ab1b-4b6d-823f-14388cd110e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:58:01 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Volume volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 (00ab78a6-0edc-4ae4-a736-955691d57ec9): created successfully
Jul 07 22:58:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db9a16fe-ab1b-4b6d-823f-14388cd110e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:58:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Flow 'volume_create_manager' (7e4ed8d8-f089-4e6c-ab91-e7484b193ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:58:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f57f8fe6-95ca-4523-a3c4-0b4d70b6df1d tempest-TestStampPattern-134998232 None] Created volume successfully.
Jul 07 22:58:11 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:58:11 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:58:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-d19de55c-8fdc-45dc-84c9-eb1afa250c2b req-b2117ff3-26f2-4715-bf96-4fa08d057498 tempest-TestStampPattern-134998232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:58:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-d19de55c-8fdc-45dc-84c9-eb1afa250c2b req-b2117ff3-26f2-4715-bf96-4fa08d057498 tempest-TestStampPattern-134998232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:58:40 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb146a8-77ea-48ab-99b6-bd6806523845]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:58:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-d19de55c-8fdc-45dc-84c9-eb1afa250c2b req-b2117ff3-26f2-4715-bf96-4fa08d057498 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:40 devstack sudo[104898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9
Jul 07 22:58:40 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:40 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-d19de55c-8fdc-45dc-84c9-eb1afa250c2b req-b2117ff3-26f2-4715-bf96-4fa08d057498 tempest-TestStampPattern-134998232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9" returned: 0 in 0.754s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-d19de55c-8fdc-45dc-84c9-eb1afa250c2b req-b2117ff3-26f2-4715-bf96-4fa08d057498 tempest-TestStampPattern-134998232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:58:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-d19de55c-8fdc-45dc-84c9-eb1afa250c2b req-b2117ff3-26f2-4715-bf96-4fa08d057498 tempest-TestStampPattern-134998232 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-00ab78a6-0edc-4ae4-a736-955691d57ec9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c122d22f-6dc1-4817-90ee-6ee2e738bec9', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:58:41 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-d19de55c-8fdc-45dc-84c9-eb1afa250c2b req-b2117ff3-26f2-4715-bf96-4fa08d057498 tempest-TestStampPattern-134998232 None] attachment_update completed successfully.
Jul 07 22:58:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:58:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:58:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:58:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:58:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:58:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:58:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:43 devstack sudo[105286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:58:43 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:44 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.664s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:58:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:58:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:58:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:58:49 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-cbf98925-b833-45d7-9f30-e91c640fab6a req-4c3a6b97-9b28-434f-b80d-9dfcf3ffc132 tempest-TestStampPattern-134998232 None] Terminate volume connection completed successfully.
Jul 07 22:58:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-cbf98925-b833-45d7-9f30-e91c640fab6a req-4c3a6b97-9b28-434f-b80d-9dfcf3ffc132 tempest-TestStampPattern-134998232 None] Deleting attachment c122d22f-6dc1-4817-90ee-6ee2e738bec9. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:58:51 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:58:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:58:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:58:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Creating offline snapshot 9bc8437a-f71b-4873-b76a-6126736e359a of volume 00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:58:51 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9896b040-8035-405e-bc95-e4a9e7ddc13a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:58:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:51 devstack sudo[105345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9
Jul 07 22:58:51 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:52 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9" returned: 0 in 0.770s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:52 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a 1G
Jul 07 22:58:52 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:53 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a 1G" returned: 0 in 0.862s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:53 devstack sudo[105356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a
Jul 07 22:58:53 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:54 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a" returned: 0 in 0.775s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:54 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a is being set with open permissions: ugo+rw
Jul 07 22:58:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:54 devstack sudo[105362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a
Jul 07 22:58:54 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:54 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a" returned: 0 in 0.693s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:54 devstack sudo[105365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.info
Jul 07 22:58:54 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:55 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.info" returned: 0 in 0.806s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:55 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.info is being set with open permissions: ugo+rw
Jul 07 22:58:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:55 devstack sudo[105368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.info
Jul 07 22:58:55 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:56 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.info" returned: 0 in 0.730s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.730s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:58:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b29d6f0f-a80c-4bd5-913d-8c2df0147d83 tempest-TestStampPattern-134998232 None] Create snapshot completed successfully
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Flow 'volume_create_manager' (33e2a15c-548d-4063-8ad9-492d6791e90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539b6c9f-bb32-43f1-ab6f-c34cdbea88a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539b6c9f-bb32-43f1-ab6f-c34cdbea88a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-415872664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b4ad696-c83b-4218-9d4d-acd7186f9b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e98d60123c14b03a1da3f44d382ab0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9bc8437a-f71b-4873-b76a-6126736e359a,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:59:07Z,use_quota=True,user_id='a2e25f8e41564cd388f7d6723e90b422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e0247c-bb8c-4722-a2d0-2a7b6a07d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e0247c-bb8c-4722-a2d0-2a7b6a07d41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9de440-1c33-41ac-b22a-80388511ab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9de440-1c33-41ac-b22a-80388511ab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8b4ad696-c83b-4218-9d4d-acd7186f9b83', 'volume_name': 'volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83', 'volume_size': 1, 'snapshot_id': '9bc8437a-f71b-4873-b76a-6126736e359a'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31dcb07-edec-4f95-b378-a50e56f7ee9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31dcb07-edec-4f95-b378-a50e56f7ee9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0463ff0f-6ba6-4cc9-9483-5d9e9a83ae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:06 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Volume 8b4ad696-c83b-4218-9d4d-acd7186f9b83: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83', 'volume_size': 1, 'snapshot_id': '9bc8437a-f71b-4873-b76a-6126736e359a'}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Acquiring lock "cinder-quobyte-9bc8437a-f71b-4873-b76a-6126736e359a-8b4ad696-c83b-4218-9d4d-acd7186f9b83" by "_create_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-9bc8437a-f71b-4873-b76a-6126736e359a-8b4ad696-c83b-4218-9d4d-acd7186f9b83" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Creating volume 8b4ad696-c83b-4218-9d4d-acd7186f9b83 from snapshot 9bc8437a-f71b-4873-b76a-6126736e359a {{(pid=88077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Acquiring lock "cinder-quobyte-8b4ad696-c83b-4218-9d4d-acd7186f9b83" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-8b4ad696-c83b-4218-9d4d-acd7186f9b83" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] snapshot: 9bc8437a-f71b-4873-b76a-6126736e359a, volume: 8b4ad696-c83b-4218-9d4d-acd7186f9b83,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a380863f-8c9c-421a-b5ae-f64af5e183f9]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:07 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a
Jul 07 22:59:07 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:07 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a" returned: 0 in 0.810s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00ab78a6-0edc-4ae4-a736-955691d57ec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:59:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:59:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:59:07 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13b1484-0421-4c79-ab9a-b094b791ce41]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:07 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9
Jul 07 22:59:07 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:08 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9" returned: 0 in 0.819s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:08 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83 not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:59:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:08 devstack sudo[105417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83
Jul 07 22:59:08 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:13 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83" returned: 0 in 4.712s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:13 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2df757c-14eb-4b61-8434-a455c7f33936]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:13 devstack sudo[105432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9
Jul 07 22:59:13 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:14 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9" returned: 0 in 1.049s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:14 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:59:14 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Converted 1024.00 MB image at 217.22 MB/s
Jul 07 22:59:14 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83 is being set with open permissions: ugo+rw
Jul 07 22:59:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:14 devstack sudo[105439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83
Jul 07 22:59:14 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:15 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83" returned: 0 in 0.881s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-8b4ad696-c83b-4218-9d4d-acd7186f9b83" released by "_copy_volume_from_snapshot" :: held 8.380s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-9bc8437a-f71b-4873-b76a-6126736e359a-8b4ad696-c83b-4218-9d4d-acd7186f9b83" released by "_create_volume_from_snapshot" :: held 8.411s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.427s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0463ff0f-6ba6-4cc9-9483-5d9e9a83ae70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83', 'volume_size': 1, 'snapshot_id': '9bc8437a-f71b-4873-b76a-6126736e359a'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f271b5d3-5921-492b-bcd3-5abb01a2dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:15 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Volume volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83 (8b4ad696-c83b-4218-9d4d-acd7186f9b83): created successfully
Jul 07 22:59:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f271b5d3-5921-492b-bcd3-5abb01a2dda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Flow 'volume_create_manager' (33e2a15c-548d-4063-8ad9-492d6791e90f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:59:15 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-807c2ec4-1c3f-4268-859b-0a3696f5774c tempest-TestStampPattern-134998232 None] Created volume successfully.
Jul 07 22:59:25 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=14,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:59:25 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=6,cinder:DELETE=2,cinder:UPDATE=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:59:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:59:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:59:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:59:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:43 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 22:59:43 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:44 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.849s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:59:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:59:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:59:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:59:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-2258b766-d6bb-49c6-a647-b1771126454a req-2c55d1d2-51ff-4f28-8f3d-774ed67af862 tempest-TestStampPattern-134998232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-2258b766-d6bb-49c6-a647-b1771126454a req-2c55d1d2-51ff-4f28-8f3d-774ed67af862 tempest-TestStampPattern-134998232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:48 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[32056c78-fd4d-49eb-a0a0-ce94638d9924]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-2258b766-d6bb-49c6-a647-b1771126454a req-2c55d1d2-51ff-4f28-8f3d-774ed67af862 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:48 devstack sudo[105609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83
Jul 07 22:59:48 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:48 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [req-2258b766-d6bb-49c6-a647-b1771126454a req-2c55d1d2-51ff-4f28-8f3d-774ed67af862 tempest-TestStampPattern-134998232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83" returned: 0 in 0.779s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [req-2258b766-d6bb-49c6-a647-b1771126454a req-2c55d1d2-51ff-4f28-8f3d-774ed67af862 tempest-TestStampPattern-134998232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.797s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-2258b766-d6bb-49c6-a647-b1771126454a req-2c55d1d2-51ff-4f28-8f3d-774ed67af862 tempest-TestStampPattern-134998232 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9', 'name': 'volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a11d0087-7e9b-4b1e-9d5e-637b9ceb1fb4', 'enforce_multipath': True} {{(pid=88077) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:59:48 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-2258b766-d6bb-49c6-a647-b1771126454a req-2c55d1d2-51ff-4f28-8f3d-774ed67af862 tempest-TestStampPattern-134998232 None] attachment_update completed successfully.
Jul 07 22:59:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [req-660331f3-3df2-4c9a-9914-e5b6d52c3327 req-34bb11f1-2f48-4662-a45c-6e561685037f tempest-TestStampPattern-134998232 None] Terminate volume connection completed successfully.
Jul 07 22:59:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [req-660331f3-3df2-4c9a-9914-e5b6d52c3327 req-34bb11f1-2f48-4662-a45c-6e561685037f tempest-TestStampPattern-134998232 None] Deleting attachment a11d0087-7e9b-4b1e-9d5e-637b9ceb1fb4. {{(pid=88077) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 23:00:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Acquiring lock "cinder-8b4ad696-c83b-4218-9d4d-acd7186f9b83-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Lock "cinder-8b4ad696-c83b-4218-9d4d-acd7186f9b83-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Acquiring lock "cinder-quobyte-8b4ad696-c83b-4218-9d4d-acd7186f9b83" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-8b4ad696-c83b-4218-9d4d-acd7186f9b83" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:04 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b40a16f-09ab-4c71-8a60-25b032e088ca]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:04 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83
Jul 07 23:00:04 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:05 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83" returned: 0 in 0.798s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:05 devstack sudo[106074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83
Jul 07 23:00:05 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:05 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8b4ad696-c83b-4218-9d4d-acd7186f9b83" returned: 0 in 0.681s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-8b4ad696-c83b-4218-9d4d-acd7186f9b83" released by "delete_volume" :: held 1.518s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Created reservations ['3a75c01c-3649-443f-9cdb-d8292c7dad7d', '1093f5e9-c27d-4c4b-872b-58493b41d8b2', '01672325-1294-4947-a841-d994f2317ff1', 'ffcce371-24e7-4930-9aea-4cbcf6709c40'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:06 devstack sudo[106077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:00:06 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:06 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.674s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:06 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Deleted volume successfully.
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-78f14fe7-e814-423d-9df3-1dc680b1ac1e tempest-TestStampPattern-134998232 None] Lock "cinder-8b4ad696-c83b-4218-9d4d-acd7186f9b83-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Acquiring lock "cinder-9bc8437a-f71b-4873-b76a-6126736e359a-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Lock "cinder-9bc8437a-f71b-4873-b76a-6126736e359a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Acquiring lock "cinder-quobyte-00ab78a6-0edc-4ae4-a736-955691d57ec9" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-00ab78a6-0edc-4ae4-a736-955691d57ec9" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Acquiring lock "cinder-quobyte-9bc8437a-f71b-4873-b76a-6126736e359a" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-9bc8437a-f71b-4873-b76a-6126736e359a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Deleting offline snapshot 9bc8437a-f71b-4873-b76a-6126736e359a of volume 00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:00:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] snapshot_file for this snap is: volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:00:07 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfc299d-c6ba-4bfc-9f3b-40e36de300ae]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:07 devstack sudo[106082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a
Jul 07 23:00:07 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:07 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a" returned: 0 in 0.731s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00ab78a6-0edc-4ae4-a736-955691d57ec9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:00:07 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddb5658-eb9b-482c-8d3f-a128a232f5d1]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:07 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9
Jul 07 23:00:07 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:08 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9" returned: 0 in 0.836s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:08 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a
Jul 07 23:00:08 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:09 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a" returned: 0 in 0.773s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:09 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a
Jul 07 23:00:09 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:10 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9.9bc8437a-f71b-4873-b76a-6126736e359a" returned: 0 in 0.720s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-9bc8437a-f71b-4873-b76a-6126736e359a" released by "_delete_snapshot" :: held 3.160s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-00ab78a6-0edc-4ae4-a736-955691d57ec9" released by "delete_snapshot" :: held 3.180s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:10 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Created reservations ['b1d07c0c-3c1e-4cdc-86ec-82bd31f9986e', '7652e0fe-b29e-4bf8-938d-be42c2a61f12', '2ec387a7-d37d-4a35-9e7a-372a96f3755c', '73a40b30-7623-4d73-8b7a-8fc054d8342b'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Delete snapshot completed successfully.
Jul 07 23:00:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5822d607-2f30-4308-b930-1cd4900bec3a tempest-TestStampPattern-134998232 None] Lock "cinder-9bc8437a-f71b-4873-b76a-6126736e359a-delete_snapshot" released by "delete_snapshot" :: held 4.650s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:21 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=16,cinder:UPDATE=15,cinder:INSERT=3 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:00:21 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=18,cinder:UPDATE=15,cinder:INSERT=5,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:00:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Acquiring lock "cinder-00ab78a6-0edc-4ae4-a736-955691d57ec9-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Lock "cinder-00ab78a6-0edc-4ae4-a736-955691d57ec9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Acquiring lock "cinder-quobyte-00ab78a6-0edc-4ae4-a736-955691d57ec9" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-00ab78a6-0edc-4ae4-a736-955691d57ec9" acquired by "delete_volume" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2610d823-e0ad-48c7-bd99-efcb39110b82]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:22 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9
Jul 07 23:00:22 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:23 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9" returned: 0 in 0.825s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:23 devstack sudo[106177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9
Jul 07 23:00:23 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:24 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-00ab78a6-0edc-4ae4-a736-955691d57ec9" returned: 0 in 0.678s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Lock "cinder-quobyte-00ab78a6-0edc-4ae4-a736-955691d57ec9" released by "delete_volume" :: held 1.568s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:24 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Created reservations ['980ef889-d72f-4696-b710-45e02815e0ea', 'b1ea65f8-511a-4f0b-b807-e929acac45d1', '78eb5c1a-2538-4df5-ba6a-48f37cbee585', 'c5171e21-2066-4142-88f6-e59012e5580c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:24 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:00:24 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:25 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.665s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:25 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:25 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Deleted volume successfully.
Jul 07 23:00:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-51c4b468-6051-4b14-adb5-14db59c42095 tempest-TestStampPattern-134998232 None] Lock "cinder-00ab78a6-0edc-4ae4-a736-955691d57ec9-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:34 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=4,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:00:35 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:00:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:00:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:43 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:00:43 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:44 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.675s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:00:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:00:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (1b9ea508-105e-44b2-aecb-e4cde611533f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f0ac40-9f42-4ff9-a14d-18df29e37afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f0ac40-9f42-4ff9-a14d-18df29e37afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441864329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f51de7-7400-48ee-9734-2b65405d1eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:49Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999da2fc-5242-4a2d-ad47-926c8f5c5a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (999da2fc-5242-4a2d-ad47-926c8f5c5a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12926533-95d0-4637-acfd-33de4d23b0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12926533-95d0-4637-acfd-33de4d23b0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f51de7-7400-48ee-9734-2b65405d1eba', 'volume_name': 'volume-a0f51de7-7400-48ee-9734-2b65405d1eba', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6694ea19-c5c6-40c3-b73b-76d8c511a9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6694ea19-c5c6-40c3-b73b-76d8c511a9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741b55b1-68ec-43ec-826e-c13956376b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:48 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume a0f51de7-7400-48ee-9734-2b65405d1eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f51de7-7400-48ee-9734-2b65405d1eba', 'volume_size': 1}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441864329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f51de7-7400-48ee-9734-2b65405d1eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:49Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Creating volume a0f51de7-7400-48ee-9734-2b65405d1eba {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:49 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:49 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba 1073741824
Jul 07 23:00:49 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (b7d5c93c-af3c-4d81-a526-2a8f2691abfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d66e64e-19bb-49b9-a9a0-3f21c5b343fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d66e64e-19bb-49b9-a9a0-3f21c5b343fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-95975531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ad6451-e7e1-48fc-8cb4-807a8aa745fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:49Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de04c776-4cca-4434-bc39-1e0ca836b857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de04c776-4cca-4434-bc39-1e0ca836b857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e2bd72-51fa-454c-a3f1-71d742e8cf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e2bd72-51fa-454c-a3f1-71d742e8cf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ad6451-e7e1-48fc-8cb4-807a8aa745fc', 'volume_name': 'volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe866c8-5cc1-49de-a33c-00f864520f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe866c8-5cc1-49de-a33c-00f864520f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece445fd-e71d-4f06-9db7-eb70ae69dd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume 08ad6451-e7e1-48fc-8cb4-807a8aa745fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc', 'volume_size': 1}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Flow 'volume_create_manager' (647241e5-f7f3-4e79-8801-7da0943861ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba4c3ed-eaa7-474c-80c4-bbc39c355e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ba4c3ed-eaa7-474c-80c4-bbc39c355e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4474a538-9444-42bb-93d9-57cf0d900cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc187096ae764978ab29447c4f05044f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:50Z,use_quota=True,user_id='2a61c49131554039a06cdce64118a2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c825d0-8cc6-4042-8e37-17c2861cd6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c825d0-8cc6-4042-8e37-17c2861cd6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e058a42-b425-4afa-a2b9-a9a6ecc1827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e058a42-b425-4afa-a2b9-a9a6ecc1827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4474a538-9444-42bb-93d9-57cf0d900cf0', 'volume_name': 'volume-4474a538-9444-42bb-93d9-57cf0d900cf0', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f144521-0994-4803-bbba-f59816f7a761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f144521-0994-4803-bbba-f59816f7a761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48622e38-0f20-4831-b770-d0757b128294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Volume 4474a538-9444-42bb-93d9-57cf0d900cf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4474a538-9444-42bb-93d9-57cf0d900cf0', 'volume_size': 1}
Jul 07 23:00:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:50 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba 1073741824" returned: 0 in 1.003s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:50 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba
Jul 07 23:00:50 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:50 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba" returned: 0 in 0.682s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.547s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-95975531',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ad6451-e7e1-48fc-8cb4-807a8aa745fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:49Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Creating volume 08ad6451-e7e1-48fc-8cb4-807a8aa745fc {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:50 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741b55b1-68ec-43ec-826e-c13956376b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f51de7-7400-48ee-9734-2b65405d1eba', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:50 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc 1073741824
Jul 07 23:00:50 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d340b286-91b0-458f-a884-7714695d4d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:50 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume volume-a0f51de7-7400-48ee-9734-2b65405d1eba (a0f51de7-7400-48ee-9734-2b65405d1eba): created successfully
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d340b286-91b0-458f-a884-7714695d4d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:50 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (1b9ea508-105e-44b2-aecb-e4cde611533f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:50 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-19add31c-2caa-4bae-bfaf-1f344136bc6c tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created volume successfully.
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (15ffee52-2057-4e13-bd3d-51b89dd2efee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3a9494-0ab3-448f-a1b6-0bd9e772e5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc 1073741824" returned: 0 in 0.982s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3a9494-0ab3-448f-a1b6-0bd9e772e5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1051429294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6d4fd3-fe4c-49e7-896a-d2acb28b977d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:52Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c54fa25-c95e-4269-9913-30050a86b0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c54fa25-c95e-4269-9913-30050a86b0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0d7717-961a-42d9-a42d-7222c02f6031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0d7717-961a-42d9-a42d-7222c02f6031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb6d4fd3-fe4c-49e7-896a-d2acb28b977d', 'volume_name': 'volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a116a5f-f883-493a-be09-864d3e0e9fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a116a5f-f883-493a-be09-864d3e0e9fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7de305b-c5c9-4e4a-9dda-873c4960c42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume bb6d4fd3-fe4c-49e7-896a-d2acb28b977d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d', 'volume_size': 1}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:51 devstack sudo[106255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc
Jul 07 23:00:51 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (a1d3345e-fcfb-4e84-976b-69aa085c8cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923085fa-87f2-4e16-bdc2-f94988f6be6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (923085fa-87f2-4e16-bdc2-f94988f6be6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-843387742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d26847f-c598-4676-829f-a2cf4d0888b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:52Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fac9b7f-b378-45c4-80c4-8fd0fe7bbfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fac9b7f-b378-45c4-80c4-8fd0fe7bbfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e78815-2800-4046-bce0-6f21a8f31120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e78815-2800-4046-bce0-6f21a8f31120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d26847f-c598-4676-829f-a2cf4d0888b3', 'volume_name': 'volume-7d26847f-c598-4676-829f-a2cf4d0888b3', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40641e33-82ba-4a5f-9c32-0205fc22a396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40641e33-82ba-4a5f-9c32-0205fc22a396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fa09e5-3a9d-4636-a42f-db53f2e8ae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume 7d26847f-c598-4676-829f-a2cf4d0888b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d26847f-c598-4676-829f-a2cf4d0888b3', 'volume_size': 1}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (9faa624d-4733-4256-b475-7a330c718eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b468ead2-2ceb-4d75-93d6-7d2dbd5c0ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b468ead2-2ceb-4d75-93d6-7d2dbd5c0ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1798593376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce1c562-0214-4b02-b332-a4f7ee7cd3f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:53Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db97b48b-693c-4901-8986-a385849ae6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db97b48b-693c-4901-8986-a385849ae6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b454d49-cdfd-443a-beea-dd406b700128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b454d49-cdfd-443a-beea-dd406b700128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce1c562-0214-4b02-b332-a4f7ee7cd3f3', 'volume_name': 'volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8540458e-2284-4a7c-98c0-76fdf84e99d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8540458e-2284-4a7c-98c0-76fdf84e99d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de177005-24d2-4930-b67d-02ff3d79f7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume 8ce1c562-0214-4b02-b332-a4f7ee7cd3f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3', 'volume_size': 1}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:52 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" returned: 0 in 0.942s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.141s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4474a538-9444-42bb-93d9-57cf0d900cf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc187096ae764978ab29447c4f05044f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:50Z,use_quota=True,user_id='2a61c49131554039a06cdce64118a2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Creating volume 4474a538-9444-42bb-93d9-57cf0d900cf0 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:52 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ece445fd-e71d-4f06-9db7-eb70ae69dd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0 1073741824
Jul 07 23:00:52 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27fda293-f72a-42d6-b220-280e1ad7a435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc (08ad6451-e7e1-48fc-8cb4-807a8aa745fc): created successfully
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27fda293-f72a-42d6-b220-280e1ad7a435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (b7d5c93c-af3c-4d81-a526-2a8f2691abfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:52 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-29273a02-581e-42c5-9da3-5909f5bd8a58 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created volume successfully.
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (2bbd4ea5-daf6-47ea-8904-a9852d4129fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d85033b-9305-4cf4-8b2f-090ce9714af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d85033b-9305-4cf4-8b2f-090ce9714af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-773320478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b873fa-41b1-4d63-85a7-cbac3924efee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:53Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319cbe5f-374b-4372-afd3-a1f23d67773f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (319cbe5f-374b-4372-afd3-a1f23d67773f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d55837-0918-4916-80e8-8412c5d7ab73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d55837-0918-4916-80e8-8412c5d7ab73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02b873fa-41b1-4d63-85a7-cbac3924efee', 'volume_name': 'volume-02b873fa-41b1-4d63-85a7-cbac3924efee', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e6500c-0ce1-4656-9282-b7e7530a8871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1e6500c-0ce1-4656-9282-b7e7530a8871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d82d2d-18bb-445a-967f-d6cd0d3e146e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:53 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume 02b873fa-41b1-4d63-85a7-cbac3924efee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02b873fa-41b1-4d63-85a7-cbac3924efee', 'volume_size': 1}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Flow 'volume_create_manager' (1e7515d4-c00b-47e3-b50f-c0945cbc4d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87230a69-8e5b-44b4-84ac-b057546a9ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:53 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0 1073741824" returned: 0 in 1.167s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87230a69-8e5b-44b4-84ac-b057546a9ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bd8085-f220-43a9-8848-9d4565e27ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e25baa7aac4fc5ace2af4e27f8d391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:54Z,use_quota=True,user_id='f34e609663fb4fd4832ee229289aefda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4937682-2fd6-42dd-8fdd-12799ce79aab),volume_type_id=b4937682-2fd6-42dd-8fdd-12799ce79aab)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f76a05e-0e36-47e6-816f-955afee426d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f76a05e-0e36-47e6-816f-955afee426d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6913148b-e003-4a75-8ff7-814b50dd26b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.image.glance [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Creating Keystone auth plugin from conf {{(pid=88077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (a1513b06-db4b-44b9-9c8e-088fc82e7dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f41aa32-5b1f-4681-9fc6-62d3c1455c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f41aa32-5b1f-4681-9fc6-62d3c1455c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1455475108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4deb6d49-aec5-471b-a065-cd2906de57ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:54Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c81843-63a1-451e-9a7b-1df4edbc5966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9c81843-63a1-451e-9a7b-1df4edbc5966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d785f9c-e9a7-4f5f-a70a-c72fd4172256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d785f9c-e9a7-4f5f-a70a-c72fd4172256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4deb6d49-aec5-471b-a065-cd2906de57ae', 'volume_name': 'volume-4deb6d49-aec5-471b-a065-cd2906de57ae', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d5100a-2a90-4ba9-84be-759b06891707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d5100a-2a90-4ba9-84be-759b06891707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9c9af5-5ec5-406f-9e14-287ef2fe7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume 4deb6d49-aec5-471b-a065-cd2906de57ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4deb6d49-aec5-471b-a065-cd2906de57ae', 'volume_size': 1}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:54 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0
Jul 07 23:00:54 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6913148b-e003-4a75-8ff7-814b50dd26b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '82bd8085-f220-43a9-8848-9d4565e27ec0', 'volume_name': 'volume-82bd8085-f220-43a9-8848-9d4565e27ec0', 'volume_size': 1, 'image_id': 'dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8961710504604024f31a5ca0b8dc3cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '75e25baa7aac4fc5ace2af4e27f8d391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '794e724d1dd04209c749a7af7fcfa076550c0bd7ecf5f2f9535e37753d2173a0353d48b40e71112e007abfff16de1a97fa0eb44e202eaac579acb8406d727d2d', 'id': 'dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'created_at': datetime.datetime(2026, 7, 7, 21, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcce7896-dcc7-4e9c-bcb9-0ccc55d71386/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72b65310>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831b8e85-8e81-4039-ad46-a30bc531c111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831b8e85-8e81-4039-ad46-a30bc531c111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5b30a0-7232-4393-a917-a485c745a6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Volume 82bd8085-f220-43a9-8848-9d4565e27ec0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-82bd8085-f220-43a9-8848-9d4565e27ec0', 'volume_size': 1, 'image_id': 'dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8961710504604024f31a5ca0b8dc3cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '75e25baa7aac4fc5ace2af4e27f8d391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '794e724d1dd04209c749a7af7fcfa076550c0bd7ecf5f2f9535e37753d2173a0353d48b40e71112e007abfff16de1a97fa0eb44e202eaac579acb8406d727d2d', 'id': 'dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'created_at': datetime.datetime(2026, 7, 7, 21, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcce7896-dcc7-4e9c-bcb9-0ccc55d71386/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72b65310>}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Trying to clone 82bd8085-f220-43a9-8848-9d4565e27ec0 from image dcce7896-dcc7-4e9c-bcb9-0ccc55d71386 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'metadata': {}}]). {{(pid=88077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 23:00:54 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87f5a64-89a4-464b-8d54-e1ecf9141f85]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:54 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD
Jul 07 23:00:54 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:54 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0" returned: 0 in 0.679s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] <== create_volume: return (2083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.078s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1051429294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb6d4fd3-fe4c-49e7-896a-d2acb28b977d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:52Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Creating volume bb6d4fd3-fe4c-49e7-896a-d2acb28b977d {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:54 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48622e38-0f20-4831-b770-d0757b128294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4474a538-9444-42bb-93d9-57cf0d900cf0', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack sudo[106271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d 1073741824
Jul 07 23:00:54 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407a27d5-644b-41b6-ae61-74cc483fa945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Volume volume-4474a538-9444-42bb-93d9-57cf0d900cf0 (4474a538-9444-42bb-93d9-57cf0d900cf0): created successfully
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407a27d5-644b-41b6-ae61-74cc483fa945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Flow 'volume_create_manager' (647241e5-f7f3-4e79-8801-7da0943861ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9339e959-4a7c-44a2-91a5-bea2e0298ab9 tempest-CinderUnicodeTest-355648430 None] Created volume successfully.
Jul 07 23:00:55 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD" returned: 0 in 0.809s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:55 devstack sudo[106275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD
Jul 07 23:00:55 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Flow 'volume_create_manager' (fbfe10cd-367f-4c39-b34d-709526bb37c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390af61e-2d36-44e5-9d58-613982d7a5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390af61e-2d36-44e5-9d58-613982d7a5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-256797507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf15755c-2ed1-4230-b131-e25ecc3108e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc187096ae764978ab29447c4f05044f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:56Z,use_quota=True,user_id='2a61c49131554039a06cdce64118a2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f7701c-1211-4624-a9c7-0be921064412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f7701c-1211-4624-a9c7-0be921064412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11852dc5-beeb-4fb0-a227-e989fd665ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11852dc5-beeb-4fb0-a227-e989fd665ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf15755c-2ed1-4230-b131-e25ecc3108e5', 'volume_name': 'volume-cf15755c-2ed1-4230-b131-e25ecc3108e5', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed24358b-26b0-4670-817d-60e1d55aeaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed24358b-26b0-4670-817d-60e1d55aeaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87befa9-4a8e-41ad-b1a4-4d3b2c7ecf85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:55 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Volume cf15755c-2ed1-4230-b131-e25ecc3108e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf15755c-2ed1-4230-b131-e25ecc3108e5', 'volume_size': 1}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:55 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d 1073741824" returned: 0 in 1.028s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:56 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d
Jul 07 23:00:56 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:56 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD" returned: 1 in 0.934s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Temporary image dcce7896-dcc7-4e9c-bcb9-0ccc55d71386 is fetched for user f34e609663fb4fd4832ee229289aefda. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ace494-dff5-41c0-a212-8ccc1a96d8e2]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:56 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD
Jul 07 23:00:56 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:56 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d" returned: 0 in 0.675s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.320s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-843387742',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d26847f-c598-4676-829f-a2cf4d0888b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:52Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Creating volume 7d26847f-c598-4676-829f-a2cf4d0888b3 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:56 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:56 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3 1073741824
Jul 07 23:00:56 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7de305b-c5c9-4e4a-9dda-873c4960c42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da55359a-096f-45fe-bbfd-deab2b16e78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:56 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d (bb6d4fd3-fe4c-49e7-896a-d2acb28b977d): created successfully
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da55359a-096f-45fe-bbfd-deab2b16e78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:56 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (15ffee52-2057-4e13-bd3d-51b89dd2efee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d90d632b-eb65-46d0-b058-32f786541fa1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created volume successfully.
Jul 07 23:00:57 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD" returned: 0 in 0.827s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:57 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD
Jul 07 23:00:57 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:57 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3 1073741824" returned: 0 in 0.859s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:57 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3
Jul 07 23:00:57 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:57 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD" returned: 1 in 0.758s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:00:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:58 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3" returned: 0 in 0.673s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.463s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1798593376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce1c562-0214-4b02-b332-a4f7ee7cd3f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:53Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Creating volume 8ce1c562-0214-4b02-b332-a4f7ee7cd3f3 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:58 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:58 devstack sudo[106305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3 1073741824
Jul 07 23:00:58 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63fa09e5-3a9d-4636-a42f-db53f2e8ae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d26847f-c598-4676-829f-a2cf4d0888b3', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a35d691-86b8-44de-af61-a154a2ed857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:58 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume volume-7d26847f-c598-4676-829f-a2cf4d0888b3 (7d26847f-c598-4676-829f-a2cf4d0888b3): created successfully
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a35d691-86b8-44de-af61-a154a2ed857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (a1d3345e-fcfb-4e84-976b-69aa085c8cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:58 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-975ee281-92ba-4170-9c46-e13b8086da26 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created volume successfully.
Jul 07 23:00:59 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3 1073741824" returned: 0 in 0.915s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:59 devstack sudo[106311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3
Jul 07 23:00:59 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:59 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3" returned: 0 in 0.649s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.611s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-773320478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b873fa-41b1-4d63-85a7-cbac3924efee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:53Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Creating volume 02b873fa-41b1-4d63-85a7-cbac3924efee {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:59 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:59 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee 1073741824
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de177005-24d2-4930-b67d-02ff3d79f7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:59 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39e5482-d707-4c43-a32c-206ee9b21fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:59 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3 (8ce1c562-0214-4b02-b332-a4f7ee7cd3f3): created successfully
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c39e5482-d707-4c43-a32c-206ee9b21fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:59 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (9faa624d-4733-4256-b475-7a330c718eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:59 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-66776160-7e32-4bf2-b8c7-9b5dc023cbc0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created volume successfully.
Jul 07 23:01:00 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee 1073741824" returned: 0 in 0.937s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:00 devstack sudo[106319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee
Jul 07 23:01:00 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:01 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee" returned: 0 in 0.721s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.462s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d82d2d-18bb-445a-967f-d6cd0d3e146e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b873fa-41b1-4d63-85a7-cbac3924efee', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae9efdc-c124-421e-8cb7-fce343b7899c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Creating offline snapshot d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd of volume 08ad6451-e7e1-48fc-8cb4-807a8aa745fc {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:01:01 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume volume-02b873fa-41b1-4d63-85a7-cbac3924efee (02b873fa-41b1-4d63-85a7-cbac3924efee): created successfully
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bae9efdc-c124-421e-8cb7-fce343b7899c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (2bbd4ea5-daf6-47ea-8904-a9852d4129fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5bfe0c-f4fb-46fa-a0a8-bf873872a673]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5a1552a7-2d70-4f5e-9628-26d054b5b279 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created volume successfully.
Jul 07 23:01:01 devstack sudo[106323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc
Jul 07 23:01:01 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:02 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" returned: 0 in 0.848s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:02 devstack sudo[106329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd 1G
Jul 07 23:01:02 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:03 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd 1G" returned: 0 in 0.891s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:03 devstack sudo[106335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd
Jul 07 23:01:03 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:04 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd" returned: 0 in 0.685s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:04 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd is being set with open permissions: ugo+rw
Jul 07 23:01:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:04 devstack sudo[106340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd
Jul 07 23:01:04 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:04 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd" returned: 0 in 0.666s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:04 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.info
Jul 07 23:01:04 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:05 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.info" returned: 0 in 0.676s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:05 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.info is being set with open permissions: ugo+rw
Jul 07 23:01:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:05 devstack sudo[106346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.info
Jul 07 23:01:05 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:06 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.info" returned: 0 in 0.656s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.539s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.885s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1455475108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4deb6d49-aec5-471b-a065-cd2906de57ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='574c06db9b2740609177d223a4d732bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:54Z,use_quota=True,user_id='2107b4820fc440a19af5a3a71dc6fca3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Creating volume 4deb6d49-aec5-471b-a065-cd2906de57ae {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:06 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:06 devstack sudo[106349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae 1073741824
Jul 07 23:01:06 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:06 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-890fdf3f-9275-416b-a7f9-143ae172d0ab tempest-CreateVolumesFromSnapshotTest-1725674912 None] Create snapshot completed successfully
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (320a7706-0c48-4d04-9422-de7401b751be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdb51e0-6bab-48df-a67a-a201095a20fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acdb51e0-6bab-48df-a67a-a201095a20fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1996204160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d846b362-eb84-4be8-8728-67c286e4cdd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:07Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7691fb27-4974-4094-9e2c-7469ea957803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7691fb27-4974-4094-9e2c-7469ea957803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5936c79-ad88-49b3-9137-8c078b3f2cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5936c79-ad88-49b3-9137-8c078b3f2cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd846b362-eb84-4be8-8728-67c286e4cdd9', 'volume_name': 'volume-d846b362-eb84-4be8-8728-67c286e4cdd9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db67e705-8edd-4970-a7dc-c185ac633fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db67e705-8edd-4970-a7dc-c185ac633fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23163a5-3f56-4e7d-ae47-8aa723c00de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:06 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume d846b362-eb84-4be8-8728-67c286e4cdd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d846b362-eb84-4be8-8728-67c286e4cdd9', 'volume_size': 1}
Jul 07 23:01:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:07 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae 1073741824" returned: 0 in 0.989s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:07 devstack sudo[106354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae
Jul 07 23:01:07 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (e7ba03cc-a94b-48a2-ae17-46e021d28fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9909c2fb-b8b4-41d8-9500-01dae5c8af68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9909c2fb-b8b4-41d8-9500-01dae5c8af68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1940161001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adf8cc5-6265-4185-9acf-927c567526e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:07Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b500ad05-2ad1-4c4e-a2bd-54fdc440ba2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b500ad05-2ad1-4c4e-a2bd-54fdc440ba2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df7103e-7c61-4d03-ada5-4f275db1e251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df7103e-7c61-4d03-ada5-4f275db1e251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4adf8cc5-6265-4185-9acf-927c567526e6', 'volume_name': 'volume-4adf8cc5-6265-4185-9acf-927c567526e6', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ce93f7-84dd-4493-b4f5-d65c000f1e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ce93f7-84dd-4493-b4f5-d65c000f1e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35cb863-10aa-4f2c-8a65-41e2af7cd7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume 4adf8cc5-6265-4185-9acf-927c567526e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4adf8cc5-6265-4185-9acf-927c567526e6', 'volume_size': 1}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (b307cb00-6c64-4bc6-a017-a8770b9f6dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ebd3c8-090c-4c40-bf0a-589621225654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14ebd3c8-090c-4c40-bf0a-589621225654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962975835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed069eb-603f-42a5-8deb-69fcf8dc67b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:08Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db522f2-0773-46e7-ad11-51dae696b0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db522f2-0773-46e7-ad11-51dae696b0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16b63cc-88dd-4f09-b5b4-8e938918d33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16b63cc-88dd-4f09-b5b4-8e938918d33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ed069eb-603f-42a5-8deb-69fcf8dc67b2', 'volume_name': 'volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f40b10-5241-4df1-9192-94ba02051b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f40b10-5241-4df1-9192-94ba02051b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef29146-ea83-4bc9-84c0-44a90bff0f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume 9ed069eb-603f-42a5-8deb-69fcf8dc67b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2', 'volume_size': 1}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:07 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae" returned: 0 in 0.753s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.948s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-256797507',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf15755c-2ed1-4230-b131-e25ecc3108e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc187096ae764978ab29447c4f05044f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:56Z,use_quota=True,user_id='2a61c49131554039a06cdce64118a2a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Creating volume cf15755c-2ed1-4230-b131-e25ecc3108e5 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:07 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9c9af5-5ec5-406f-9e14-287ef2fe7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4deb6d49-aec5-471b-a065-cd2906de57ae', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:07 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 1073741824
Jul 07 23:01:07 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c3f8cc-a772-44c5-be86-d408727b2ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:07 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Volume volume-4deb6d49-aec5-471b-a065-cd2906de57ae (4deb6d49-aec5-471b-a065-cd2906de57ae): created successfully
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c3f8cc-a772-44c5-be86-d408727b2ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:07 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Flow 'volume_create_manager' (a1513b06-db4b-44b9-9c8e-088fc82e7dcf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:08 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ad3fc069-2af0-4e08-a373-073cdaa5e0fe tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created volume successfully.
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (e6339112-29bd-46d0-99ba-78622da16ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8301b70-c6bf-47a4-b233-1b4a8045db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8301b70-c6bf-47a4-b233-1b4a8045db80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-413890058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ea0c9c-22cb-43bd-827c-f30bc8bf1390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:08Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb569fa5-837a-4883-9250-d28f6d58e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb569fa5-837a-4883-9250-d28f6d58e580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a42c90-ed87-4d2d-8fb3-d1f019895728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a42c90-ed87-4d2d-8fb3-d1f019895728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ea0c9c-22cb-43bd-827c-f30bc8bf1390', 'volume_name': 'volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a108f54f-a09e-4fcf-99e9-2bb691188f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a108f54f-a09e-4fcf-99e9-2bb691188f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b4d897-66e6-4ee9-8911-1b2d2e334b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:08 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume b9ea0c9c-22cb-43bd-827c-f30bc8bf1390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390', 'volume_size': 1}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (12997f68-6c2b-4c26-8171-488b74d2e52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54de1379-96e4-41be-bf5d-20abd882ab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54de1379-96e4-41be-bf5d-20abd882ab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-569756547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4104266-0c64-4b9d-8c77-e313c211c420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:09Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18388e5a-cdc6-4016-9b93-c10a2f53e9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18388e5a-cdc6-4016-9b93-c10a2f53e9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d777442b-031a-4f2b-9a56-2b274ba51cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d777442b-031a-4f2b-9a56-2b274ba51cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4104266-0c64-4b9d-8c77-e313c211c420', 'volume_name': 'volume-f4104266-0c64-4b9d-8c77-e313c211c420', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3e8996-c7e5-4ff2-8e09-992c3c5f92ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3e8996-c7e5-4ff2-8e09-992c3c5f92ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6802627a-1078-4cb7-9f2c-791adf885d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:08 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume f4104266-0c64-4b9d-8c77-e313c211c420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4104266-0c64-4b9d-8c77-e313c211c420', 'volume_size': 1}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:08 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 1073741824" returned: 0 in 1.027s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-4deb6d49-aec5-471b-a065-cd2906de57ae-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-4deb6d49-aec5-471b-a065-cd2906de57ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:09 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5
Jul 07 23:01:09 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-quobyte-4deb6d49-aec5-471b-a065-cd2906de57ae" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-4deb6d49-aec5-471b-a065-cd2906de57ae" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52b148e-01d8-4b04-af42-c5d4c26621a7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:09 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae
Jul 07 23:01:09 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:09 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5" returned: 0 in 0.705s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.702s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82bd8085-f220-43a9-8848-9d4565e27ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e25baa7aac4fc5ace2af4e27f8d391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:54Z,use_quota=True,user_id='f34e609663fb4fd4832ee229289aefda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4937682-2fd6-42dd-8fdd-12799ce79aab),volume_type_id=b4937682-2fd6-42dd-8fdd-12799ce79aab)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Creating volume 82bd8085-f220-43a9-8848-9d4565e27ec0 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:09 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:09 devstack sudo[106368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 1073741824
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87befa9-4a8e-41ad-b1a4-4d3b2c7ecf85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf15755c-2ed1-4230-b131-e25ecc3108e5', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:09 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca10808f-296b-4ced-987b-d037bb541b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:09 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Volume volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 (cf15755c-2ed1-4230-b131-e25ecc3108e5): created successfully
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca10808f-296b-4ced-987b-d037bb541b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Flow 'volume_create_manager' (fbfe10cd-367f-4c39-b34d-709526bb37c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:09 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d9fbfeef-3022-4a91-b69b-dfbf982ca744 tempest-CinderUnicodeTest-355648430 None] Created volume successfully.
Jul 07 23:01:09 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae" returned: 0 in 0.827s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:09 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae
Jul 07 23:01:09 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:10 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 1073741824" returned: 0 in 0.863s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:10 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4deb6d49-aec5-471b-a065-cd2906de57ae" returned: 0 in 0.746s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:10 devstack sudo[106380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0
Jul 07 23:01:10 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-4deb6d49-aec5-471b-a065-cd2906de57ae" released by "delete_volume" :: held 1.621s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created reservations ['25a39e96-9f58-4e10-82a3-df1b601ec688', '8a59d863-96f9-4ded-b6db-549f04cefb3c', '43e63199-de5e-4969-aae5-854583f1e4a2', 'ba970931-1278-4057-b8b6-5e8c3de6ac7b'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:10 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:10 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-02b873fa-41b1-4d63-85a7-cbac3924efee-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-02b873fa-41b1-4d63-85a7-cbac3924efee-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-quobyte-02b873fa-41b1-4d63-85a7-cbac3924efee" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-02b873fa-41b1-4d63-85a7-cbac3924efee" acquired by "delete_volume" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9353da61-6ddb-4860-9808-99c2dbf8a0dd]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:11 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0" returned: 0 in 0.822s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.498s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1996204160',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d846b362-eb84-4be8-8728-67c286e4cdd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:07Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Creating volume d846b362-eb84-4be8-8728-67c286e4cdd9 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:11 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:11 devstack sudo[106386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee
Jul 07 23:01:11 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:11 devstack sudo[106387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9 1073741824
Jul 07 23:01:11 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Attempting download of dcce7896-dcc7-4e9c-bcb9-0ccc55d71386 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'metadata': {}}])) to volume 82bd8085-f220-43a9-8848-9d4565e27ec0. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a57a664-d621-416c-bd7c-e8a8f7b1574d]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_62_hq0vn {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:11 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.844s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Deleted volume successfully.
Jul 07 23:01:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f623a411-7a97-4003-98d2-2c7aa5217369 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-4deb6d49-aec5-471b-a065-cd2906de57ae-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:11 devstack sudo[106391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_62_hq0vn
Jul 07 23:01:11 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:12 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_62_hq0vn" returned: 0 in 0.813s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_62_hq0vn {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:12 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9 1073741824" returned: 0 in 0.960s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:12 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee" returned: 0 in 1.080s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:12 devstack sudo[106403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee
Jul 07 23:01:12 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:12 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9
Jul 07 23:01:12 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:12 devstack sudo[106402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_62_hq0vn
Jul 07 23:01:12 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:13 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:13 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_62_hq0vn" returned: 1 in 0.738s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_62_hq0vn' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-02b873fa-41b1-4d63-85a7-cbac3924efee" returned: 0 in 0.703s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e690afd-e650-4c59-ad04-8eaa2ed14520]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-02b873fa-41b1-4d63-85a7-cbac3924efee" released by "delete_volume" :: held 1.841s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:13 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9" returned: 0 in 0.708s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.845s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1940161001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adf8cc5-6265-4185-9acf-927c567526e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:07Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Creating volume 4adf8cc5-6265-4185-9acf-927c567526e6 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:13 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23163a5-3f56-4e7d-ae47-8aa723c00de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d846b362-eb84-4be8-8728-67c286e4cdd9', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:13 devstack sudo[106414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6 1073741824
Jul 07 23:01:13 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949dad8d-b57c-482b-9d5f-dab8e5609790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:13 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume volume-d846b362-eb84-4be8-8728-67c286e4cdd9 (d846b362-eb84-4be8-8728-67c286e4cdd9): created successfully
Jul 07 23:01:13 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD
Jul 07 23:01:13 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (949dad8d-b57c-482b-9d5f-dab8e5609790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (320a7706-0c48-4d04-9422-de7401b751be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created reservations ['1712a402-08b7-4bc1-b180-4a24d164947f', '3ab8542c-8116-475a-90f3-352bf50a7705', '7c1cd130-f337-4cd3-b514-4eb8fd29f1af', '78c5efe2-5aec-47ae-9bb9-7dfd3611df84'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:13 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1571bd21-50bb-413a-bd51-d27b4681f20a tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created volume successfully.
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:13 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:13 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-quobyte-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[40729e33-8372-4248-b337-bdfa01a9e882]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:13 devstack sudo[106419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3
Jul 07 23:01:13 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:14 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD" returned: 0 in 1.017s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:14 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.832s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:14 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:14 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Deleted volume successfully.
Jul 07 23:01:14 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6 1073741824" returned: 0 in 1.080s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8f5205c5-116a-4ee6-881b-b7367b3ca5fc tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-02b873fa-41b1-4d63-85a7-cbac3924efee-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:14 devstack sudo[106428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD
Jul 07 23:01:14 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:14 devstack sudo[106429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6
Jul 07 23:01:14 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:14 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3" returned: 0 in 0.913s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:14 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3
Jul 07 23:01:14 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:15 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6" returned: 0 in 0.700s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.265s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962975835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ed069eb-603f-42a5-8deb-69fcf8dc67b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:08Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Creating volume 9ed069eb-603f-42a5-8deb-69fcf8dc67b2 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:15 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:15 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD" returned: 1 in 0.885s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] dcce7896-dcc7-4e9c-bcb9-0ccc55d71386 was raw, converting to raw {{(pid=88077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:15 devstack sudo[106441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2 1073741824
Jul 07 23:01:15 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a35cb863-10aa-4f2c-8a65-41e2af7cd7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4adf8cc5-6265-4185-9acf-927c567526e6', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:15 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0
Jul 07 23:01:15 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7998dcd-42bc-4e72-954e-7f74c11a7bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:15 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume volume-4adf8cc5-6265-4185-9acf-927c567526e6 (4adf8cc5-6265-4185-9acf-927c567526e6): created successfully
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7998dcd-42bc-4e72-954e-7f74c11a7bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (e7ba03cc-a94b-48a2-ae17-46e021d28fc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:15 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9fdb72b1-7fb2-43b8-b81d-fdf89c9d36d0 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created volume successfully.
Jul 07 23:01:15 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3" returned: 0 in 0.766s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3" released by "delete_volume" :: held 1.743s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created reservations ['ff402c41-aec8-4370-bebe-92ae940bbbc6', '0d9c490a-059c-49e3-95f9-11124ef63746', 'd17000fe-f754-4a26-98a5-aa8c6507fd2a', '86dfa4a8-f141-41c8-b8b1-6872d405d6e2'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:15 devstack sudo[106448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:15 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-7d26847f-c598-4676-829f-a2cf4d0888b3-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-7d26847f-c598-4676-829f-a2cf4d0888b3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-quobyte-7d26847f-c598-4676-829f-a2cf4d0888b3" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-7d26847f-c598-4676-829f-a2cf4d0888b3" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:16 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0" returned: 0 in 0.908s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dcce7896-dcc7-4e9c-bcb9-0ccc55d71386_blswxglidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 23:01:16 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b66f769-3548-4b84-ae72-4dd9b07bc1cb]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:16 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 1G
Jul 07 23:01:16 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:16 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2 1073741824" returned: 0 in 1.122s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:16 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3
Jul 07 23:01:16 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:16 devstack sudo[106461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2
Jul 07 23:01:16 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:16 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.975s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Deleted volume successfully.
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-52da8217-cf94-4c7a-b546-c8e703729fd1 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-8ce1c562-0214-4b02-b332-a4f7ee7cd3f3-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:16 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 1G" returned: 0 in 0.910s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac3109c-e995-444a-b999-a1f67a155067]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:16 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2" returned: 0 in 0.750s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.761s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-413890058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ea0c9c-22cb-43bd-827c-f30bc8bf1390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:08Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Creating volume b9ea0c9c-22cb-43bd-827c-f30bc8bf1390 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:16 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:17 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ef29146-ea83-4bc9-84c0-44a90bff0f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:17 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390 1073741824
Jul 07 23:01:17 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0642a04e-7c55-435a-b9f9-a90d938d0785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3" returned: 0 in 1.028s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:17 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2 (9ed069eb-603f-42a5-8deb-69fcf8dc67b2): created successfully
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0642a04e-7c55-435a-b9f9-a90d938d0785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:17 devstack sudo[106474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3
Jul 07 23:01:17 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (b307cb00-6c64-4bc6-a017-a8770b9f6dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:17 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0
Jul 07 23:01:17 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:17 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1b32d797-f96b-4dbd-93b9-a3a3f13a9333 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created volume successfully.
Jul 07 23:01:17 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d26847f-c598-4676-829f-a2cf4d0888b3" returned: 0 in 0.741s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-7d26847f-c598-4676-829f-a2cf4d0888b3" released by "delete_volume" :: held 1.827s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:17 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0" returned: 0 in 0.893s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created reservations ['25a5beb5-6c18-423c-b870-0e01fd4a18e7', '6dbf7c83-1964-4682-addd-270dd147c4a0', '8ccd9e26-1727-4afe-afab-7629ae29f223', '2a4134c3-efc2-4cb8-9b5a-7fec102e9405'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:17 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390 1073741824" returned: 0 in 0.904s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:17 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0
Jul 07 23:01:17 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:17 devstack sudo[106484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390
Jul 07 23:01:17 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:18 devstack sudo[106487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:18 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-quobyte-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b180b7-a8f0-44b6-a973-1f6c33998c39]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:18 devstack sudo[106489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d
Jul 07 23:01:18 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:18 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0" returned: 1 in 0.886s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:01:18 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Downloaded image dcce7896-dcc7-4e9c-bcb9-0ccc55d71386 ((None, [{'url': 'file:///opt/stack/data/glance/images/dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'metadata': {}}])) to volume 82bd8085-f220-43a9-8848-9d4565e27ec0 successfully. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Temporary image dcce7896-dcc7-4e9c-bcb9-0ccc55d71386 for user f34e609663fb4fd4832ee229289aefda is deleted. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Marking volume 82bd8085-f220-43a9-8848-9d4565e27ec0 as bootable. {{(pid=88077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390" returned: 0 in 0.788s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.098s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-569756547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4104266-0c64-4b9d-8c77-e313c211c420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887f69ad6fde41899e900a8673662a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:09Z,use_quota=True,user_id='8202fb10d37c4fd2abefca46035fd190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Creating volume f4104266-0c64-4b9d-8c77-e313c211c420 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:18 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Copying metadata from image dcce7896-dcc7-4e9c-bcb9-0ccc55d71386 to 82bd8085-f220-43a9-8848-9d4565e27ec0. {{(pid=88077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Creating volume glance metadata for volume 82bd8085-f220-43a9-8848-9d4565e27ec0 backed by image dcce7896-dcc7-4e9c-bcb9-0ccc55d71386 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd8961710504604024f31a5ca0b8dc3cd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 23:01:18 devstack sudo[106496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420 1073741824
Jul 07 23:01:18 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b4d897-66e6-4ee9-8911-1b2d2e334b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859bc335-a884-49ab-8a67-fa57fac2ca59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:18 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.833s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:18 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Deleted volume successfully.
Jul 07 23:01:18 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390 (b9ea0c9c-22cb-43bd-827c-f30bc8bf1390): created successfully
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859bc335-a884-49ab-8a67-fa57fac2ca59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (e6339112-29bd-46d0-99ba-78622da16ecf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3958eb7a-039a-492e-ab1e-f23be2d020d0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-7d26847f-c598-4676-829f-a2cf4d0888b3-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:18 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-997a7810-0491-4ced-ab64-d70b07a7e793 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created volume successfully.
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5b30a0-7232-4393-a917-a485c745a6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82bd8085-f220-43a9-8848-9d4565e27ec0', 'volume_size': 1, 'image_id': 'dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd8961710504604024f31a5ca0b8dc3cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '75e25baa7aac4fc5ace2af4e27f8d391', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '794e724d1dd04209c749a7af7fcfa076550c0bd7ecf5f2f9535e37753d2173a0353d48b40e71112e007abfff16de1a97fa0eb44e202eaac579acb8406d727d2d', 'id': 'dcce7896-dcc7-4e9c-bcb9-0ccc55d71386', 'created_at': datetime.datetime(2026, 7, 7, 21, 0, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 0, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dcce7896-dcc7-4e9c-bcb9-0ccc55d71386/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72b65310>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cb1266-c1d9-4ed4-9b7e-f1af06a8599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:18 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Volume volume-82bd8085-f220-43a9-8848-9d4565e27ec0 (82bd8085-f220-43a9-8848-9d4565e27ec0): created successfully
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01cb1266-c1d9-4ed4-9b7e-f1af06a8599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Flow 'volume_create_manager' (1e7515d4-c00b-47e3-b50f-c0945cbc4d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:18 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3c575ca4-e7b9-4ebd-9e24-91775ba2a8f8 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Created volume successfully.
Jul 07 23:01:19 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d" returned: 0 in 0.812s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:19 devstack sudo[106501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d
Jul 07 23:01:19 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Acquiring lock "cinder-82bd8085-f220-43a9-8848-9d4565e27ec0-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Lock "cinder-82bd8085-f220-43a9-8848-9d4565e27ec0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Acquiring lock "cinder-quobyte-82bd8085-f220-43a9-8848-9d4565e27ec0" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Lock "cinder-quobyte-82bd8085-f220-43a9-8848-9d4565e27ec0" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafd00dc-87cd-436e-972c-7fb7ba92d80e]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:19 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420 1073741824" returned: 0 in 1.055s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:19 devstack sudo[106507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0
Jul 07 23:01:19 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:19 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420
Jul 07 23:01:19 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:19 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d" returned: 0 in 0.782s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d" released by "delete_volume" :: held 1.692s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created reservations ['b9653224-2309-431d-942f-291475b9ab3e', '83fc3c88-1eba-4bd6-bf94-8d0f72affcc0', '4da68425-9d69-4a35-a655-33e7fe0b8fed', 'e5774947-def0-40bd-9544-6cd7c15dbb1f'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:20 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:20 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-a0f51de7-7400-48ee-9734-2b65405d1eba-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-a0f51de7-7400-48ee-9734-2b65405d1eba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "cinder-quobyte-a0f51de7-7400-48ee-9734-2b65405d1eba" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-a0f51de7-7400-48ee-9734-2b65405d1eba" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[894b5fbc-d554-4377-9be0-c34f4ccc8135]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:20 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0" returned: 0 in 0.898s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:20 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420" returned: 0 in 0.816s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.923s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.491s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Creating offline snapshot fa701466-9965-47a9-bcee-e233675d64d7 of volume cf15755c-2ed1-4230-b131-e25ecc3108e5 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6802627a-1078-4cb7-9f2c-791adf885d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4104266-0c64-4b9d-8c77-e313c211c420', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4fe6ba-6141-44eb-a245-c2f8cba946bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:20 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Volume volume-f4104266-0c64-4b9d-8c77-e313c211c420 (f4104266-0c64-4b9d-8c77-e313c211c420): created successfully
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4fe6ba-6141-44eb-a245-c2f8cba946bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Flow 'volume_create_manager' (12997f68-6c2b-4c26-8171-488b74d2e52b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f29970-7116-41ac-a322-4c2561196532]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:20 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba
Jul 07 23:01:20 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:20 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-2596b6b7-edb5-4b20-8ca8-a422124f0b03 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created volume successfully.
Jul 07 23:01:20 devstack sudo[106518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0
Jul 07 23:01:20 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:20 devstack sudo[106520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5
Jul 07 23:01:20 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:21 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.891s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:21 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Deleted volume successfully.
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b2ad44bc-3d82-41ce-9bb4-2296cfefca05 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-bb6d4fd3-fe4c-49e7-896a-d2acb28b977d-delete_volume" released by "delete_volume" :: held 2.844s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:21 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba" returned: 0 in 0.812s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:21 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba
Jul 07 23:01:21 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:21 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0" returned: 1 in 0.870s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:21 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0
Jul 07 23:01:21 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:21 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5" returned: 0 in 0.893s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:21 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7 1G
Jul 07 23:01:21 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-f4104266-0c64-4b9d-8c77-e313c211c420-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-f4104266-0c64-4b9d-8c77-e313c211c420-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:21 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-quobyte-f4104266-0c64-4b9d-8c77-e313c211c420" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-f4104266-0c64-4b9d-8c77-e313c211c420" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c148394-5699-427a-8cb2-88026fb6cae7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:22 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a0f51de7-7400-48ee-9734-2b65405d1eba" returned: 0 in 0.701s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-quobyte-a0f51de7-7400-48ee-9734-2b65405d1eba" released by "delete_volume" :: held 1.577s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:22 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420
Jul 07 23:01:22 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Created reservations ['6ab3825b-77c8-4e11-ae40-29a7c1e4ccad', '7cb5e086-0fd2-48c0-92ac-84e27c10ad07', '522bae73-27ca-44b5-8a86-5ce686fff8ea', '4aeebae0-e8f1-4b34-92e5-bb1d093ed888'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:22 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-82bd8085-f220-43a9-8848-9d4565e27ec0" returned: 0 in 0.766s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Lock "cinder-quobyte-82bd8085-f220-43a9-8848-9d4565e27ec0" released by "delete_volume" :: held 2.605s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:22 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:22 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Created reservations ['4e51aa2c-eb05-4f78-8578-b56ba478dff5', '06dea3da-f32b-4b7a-8973-42811be63093', 'ce259f9d-e6de-44cb-96ad-36e8eea24a25', '2b0e41bc-5102-4716-a805-4040674a8313'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:22 devstack sudo[106549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:22 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:22 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7 1G" returned: 0 in 0.995s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:22 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7
Jul 07 23:01:22 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:23 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420" returned: 0 in 1.017s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:23 devstack sudo[106556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420
Jul 07 23:01:23 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:23 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.016s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:23 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:23 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:23 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Deleted volume successfully.
Jul 07 23:01:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.909s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:23 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:23 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Deleted volume successfully.
Jul 07 23:01:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1f3ada35-e573-46e8-98e4-9267b71ac2b0 tempest-CreateVolumesFromSourceVolumeTest-852699900 None] Lock "cinder-a0f51de7-7400-48ee-9734-2b65405d1eba-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:23 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-e8832069-3707-421a-9fbf-2a1fca7a0765 tempest-VolumeAndVolumeTypeFromImageTest-831776716 None] Lock "cinder-82bd8085-f220-43a9-8848-9d4565e27ec0-delete_volume" released by "delete_volume" :: held 3.856s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:23 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7" returned: 0 in 1.018s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:23 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7 is being set with open permissions: ugo+rw
Jul 07 23:01:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:23 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7
Jul 07 23:01:23 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:24 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f4104266-0c64-4b9d-8c77-e313c211c420" returned: 0 in 1.096s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-f4104266-0c64-4b9d-8c77-e313c211c420" released by "delete_volume" :: held 2.177s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created reservations ['81c332ef-03d9-40e2-8d8b-98adf276310b', 'da91b496-752c-4b1d-9e57-0c920b4926ea', '801ebd44-7ad8-4e6f-acc6-a490063fafcc', '82dec509-20bc-4e77-9811-8c6faf2fde3b'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:24 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:24 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:24 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7" returned: 0 in 1.063s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:24 devstack sudo[106605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.info
Jul 07 23:01:24 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:25 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.874s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:25 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Deleted volume successfully.
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43e11a9f-d5e9-4e26-a667-62e3f0a5a681 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-f4104266-0c64-4b9d-8c77-e313c211c420-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-quobyte-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c48c8c1-1289-472c-8ec3-de04c662432e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:25 devstack sudo[106610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390
Jul 07 23:01:25 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:25 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.info" returned: 0 in 0.993s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:25 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.info is being set with open permissions: ugo+rw
Jul 07 23:01:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:25 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.info
Jul 07 23:01:25 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:26 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390" returned: 0 in 0.948s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:26 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390
Jul 07 23:01:26 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:26 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.info" returned: 0 in 0.976s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.115s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:26 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8fcdced4-7217-44a2-8e6d-47a76d5f5b34 tempest-CinderUnicodeTest-355648430 None] Create snapshot completed successfully
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "cinder-fa701466-9965-47a9-bcee-e233675d64d7-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Lock "cinder-fa701466-9965-47a9-bcee-e233675d64d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "cinder-quobyte-cf15755c-2ed1-4230-b131-e25ecc3108e5" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Lock "cinder-quobyte-cf15755c-2ed1-4230-b131-e25ecc3108e5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "cinder-quobyte-fa701466-9965-47a9-bcee-e233675d64d7" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Lock "cinder-quobyte-fa701466-9965-47a9-bcee-e233675d64d7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Deleting offline snapshot fa701466-9965-47a9-bcee-e233675d64d7 of volume cf15755c-2ed1-4230-b131-e25ecc3108e5 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] snapshot_file for this snap is: volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[86322f67-b1bf-4b8b-a8e3-0f01478303cf]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:27 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7
Jul 07 23:01:27 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Flow 'volume_create_manager' (e4049c29-1b6e-4b3c-824f-9526e16aa62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1320b3-b5c5-40f9-ad4b-6c299e38781e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a1320b3-b5c5-40f9-ad4b-6c299e38781e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1578755666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533eeddc-991d-4b0b-aaee-e20d65db0287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598377dd37c64462a3b040bb38f8830e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:27Z,use_quota=True,user_id='f45f2f35ed7a4aff870939765796433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:27 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aebf3ff2-09ab-4c39-a041-c5802614a0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aebf3ff2-09ab-4c39-a041-c5802614a0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1756d4cb-f895-4c21-b560-bb6864d8debb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1756d4cb-f895-4c21-b560-bb6864d8debb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '533eeddc-991d-4b0b-aaee-e20d65db0287', 'volume_name': 'volume-533eeddc-991d-4b0b-aaee-e20d65db0287', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d301bed-6c56-4f56-b29f-2d2f505a0557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d301bed-6c56-4f56-b29f-2d2f505a0557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc26e6bf-e43a-44fb-a15b-df0b9f5f4812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:27 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Volume 533eeddc-991d-4b0b-aaee-e20d65db0287: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-533eeddc-991d-4b0b-aaee-e20d65db0287', 'volume_size': 1}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1578755666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=533eeddc-991d-4b0b-aaee-e20d65db0287,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598377dd37c64462a3b040bb38f8830e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:27Z,use_quota=True,user_id='f45f2f35ed7a4aff870939765796433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Creating volume 533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:27 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390" returned: 0 in 1.065s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390" released by "delete_volume" :: held 2.066s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:27 devstack sudo[106624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 1073741824
Jul 07 23:01:27 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created reservations ['589755ac-c49f-47e8-acfd-e23c3d5b8775', 'b00da3d2-50ff-43bf-9fbe-52af2d6087e8', 'f8abbec6-a928-4f97-9b1f-3e5e9e0e69a6', '00923cdb-e7d8-40fa-994a-b9c069a778ed'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:27 devstack sudo[106626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:27 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:28 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7" returned: 0 in 1.113s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf15755c-2ed1-4230-b131-e25ecc3108e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f3d934-eb17-43f7-8fbf-d5031359a86d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:28 devstack sudo[106635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5
Jul 07 23:01:28 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:28 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.767s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:28 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Deleted volume successfully.
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ae0a6c18-1f06-4f3e-a9e6-8d0c84a82f26 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-b9ea0c9c-22cb-43bd-827c-f30bc8bf1390-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:28 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 1073741824" returned: 0 in 1.062s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:28 devstack sudo[106638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287
Jul 07 23:01:28 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-9ed069eb-603f-42a5-8deb-69fcf8dc67b2-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-9ed069eb-603f-42a5-8deb-69fcf8dc67b2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-quobyte-9ed069eb-603f-42a5-8deb-69fcf8dc67b2" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-9ed069eb-603f-42a5-8deb-69fcf8dc67b2" acquired by "delete_volume" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd8e4f1-b2a4-4ae4-8a19-be2fad858777]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:29 devstack sudo[106640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2
Jul 07 23:01:29 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:29 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5" returned: 0 in 0.904s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:29 devstack sudo[106645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7
Jul 07 23:01:29 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:29 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287" returned: 0 in 0.788s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc26e6bf-e43a-44fb-a15b-df0b9f5f4812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-533eeddc-991d-4b0b-aaee-e20d65db0287', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002a4ae9-4ea4-4a38-a909-f751794521ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:29 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Volume volume-533eeddc-991d-4b0b-aaee-e20d65db0287 (533eeddc-991d-4b0b-aaee-e20d65db0287): created successfully
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (002a4ae9-4ea4-4a38-a909-f751794521ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Flow 'volume_create_manager' (e4049c29-1b6e-4b3c-824f-9526e16aa62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:29 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6740392b-a0a2-423c-adee-a8c828d35998 tempest-VolumeDependencyTests-487528879 None] Created volume successfully.
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Flow 'volume_create_manager' (72bbda2f-f2f2-4f10-8de4-85954c06f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4366d11-bdd0-47fe-b8a8-a4aabe7a38fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4366d11-bdd0-47fe-b8a8-a4aabe7a38fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1017104998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310ebb97-d0c8-4690-80cb-4c7d7c26369b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae5651fd4d24225837848eaef60ee94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:30Z,use_quota=True,user_id='6d54a2c5b4d64556be6a3a79a894cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39fab2a-09c0-4368-a2f3-f6e7c638112c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b39fab2a-09c0-4368-a2f3-f6e7c638112c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a87fd2-fd24-4d06-b617-6b28b783161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a87fd2-fd24-4d06-b617-6b28b783161c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310ebb97-d0c8-4690-80cb-4c7d7c26369b', 'volume_name': 'volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8866af-9832-4e01-aa76-dfa732c5eccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8866af-9832-4e01-aa76-dfa732c5eccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d04b08-1bff-4cac-a5af-9f0e91d45ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:29 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Volume 310ebb97-d0c8-4690-80cb-4c7d7c26369b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b', 'volume_size': 1}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1017104998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310ebb97-d0c8-4690-80cb-4c7d7c26369b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae5651fd4d24225837848eaef60ee94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:30Z,use_quota=True,user_id='6d54a2c5b4d64556be6a3a79a894cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Creating volume 310ebb97-d0c8-4690-80cb-4c7d7c26369b {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:29 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:29 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2" returned: 0 in 0.946s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:29 devstack sudo[106651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b 1073741824
Jul 07 23:01:29 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:29 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2
Jul 07 23:01:29 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:30 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Flow 'volume_create_manager' (f931383c-b7ef-44e9-b382-81f356776d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913192bd-26d3-4c4e-80a2-1c9d6d0c9465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7" returned: 0 in 0.985s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913192bd-26d3-4c4e-80a2-1c9d6d0c9465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1407179100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631bd770-7641-443b-b44e-ff98fbd4d7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae5651fd4d24225837848eaef60ee94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:30Z,use_quota=True,user_id='6d54a2c5b4d64556be6a3a79a894cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed69ad94-3689-42f3-be01-38e3a6b325f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed69ad94-3689-42f3-be01-38e3a6b325f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254d64d4-7ba6-45c4-9a72-c25eb894421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (254d64d4-7ba6-45c4-9a72-c25eb894421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631bd770-7641-443b-b44e-ff98fbd4d7fc', 'volume_name': 'volume-631bd770-7641-443b-b44e-ff98fbd4d7fc', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:30 devstack sudo[106658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7
Jul 07 23:01:30 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53deb201-3e3f-4db9-b8af-ba56c3cad0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53deb201-3e3f-4db9-b8af-ba56c3cad0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fddec198-417a-401d-9b2e-88548878cea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:30 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Volume 631bd770-7641-443b-b44e-ff98fbd4d7fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631bd770-7641-443b-b44e-ff98fbd4d7fc', 'volume_size': 1}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Flow 'volume_create_manager' (a44f5bee-c4fa-418f-a6de-c0f190774611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6314d793-9ad7-46a6-9a10-2fb8eb529e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6314d793-9ad7-46a6-9a10-2fb8eb529e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-211873109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208e3c16-96bd-4e33-a4af-93672d15ab5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae5651fd4d24225837848eaef60ee94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:31Z,use_quota=True,user_id='6d54a2c5b4d64556be6a3a79a894cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6811fd49-cea2-477c-9463-c84de38dee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6811fd49-cea2-477c-9463-c84de38dee47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5478b84-a996-4503-9357-95c00b9c2507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5478b84-a996-4503-9357-95c00b9c2507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208e3c16-96bd-4e33-a4af-93672d15ab5c', 'volume_name': 'volume-208e3c16-96bd-4e33-a4af-93672d15ab5c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40519b30-69ad-41cf-8016-af07fa7b62a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40519b30-69ad-41cf-8016-af07fa7b62a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa38d4c-974e-4147-9832-829a5561ca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:30 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Volume 208e3c16-96bd-4e33-a4af-93672d15ab5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208e3c16-96bd-4e33-a4af-93672d15ab5c', 'volume_size': 1}
Jul 07 23:01:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:30 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-9ed069eb-603f-42a5-8deb-69fcf8dc67b2" returned: 0 in 1.134s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-9ed069eb-603f-42a5-8deb-69fcf8dc67b2" released by "delete_volume" :: held 2.157s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created reservations ['8bd67c07-b166-4a0a-bd8f-eaba9b55c3ba', '46b9b441-8182-4794-bcc2-5857eb78f8d4', '905c2325-4d94-42fb-b20f-99acae0b12d7', 'd7196bb9-12a6-48c1-98c4-0e99fcf09d7b'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:31 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b 1073741824" returned: 0 in 1.402s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:31 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:31 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:31 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5.fa701466-9965-47a9-bcee-e233675d64d7" returned: 0 in 1.193s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:31 devstack sudo[106668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b
Jul 07 23:01:31 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Lock "cinder-quobyte-fa701466-9965-47a9-bcee-e233675d64d7" released by "_delete_snapshot" :: held 4.390s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Lock "cinder-quobyte-cf15755c-2ed1-4230-b131-e25ecc3108e5" released by "delete_snapshot" :: held 4.420s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Flow 'volume_create_manager' (9900869e-4e50-4e60-8201-f4b4844309d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b41cfb7-5992-4f5f-a3c7-8c7eda47fb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b41cfb7-5992-4f5f-a3c7-8c7eda47fb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-656075538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52835d79-b118-49fa-a3f5-befd3ea8382b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae5651fd4d24225837848eaef60ee94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:31Z,use_quota=True,user_id='6d54a2c5b4d64556be6a3a79a894cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345c4d9f-00f5-4837-9b5f-4b88b4bcbc8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (345c4d9f-00f5-4837-9b5f-4b88b4bcbc8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf96cdf1-0eac-411d-a976-128725f1bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf96cdf1-0eac-411d-a976-128725f1bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52835d79-b118-49fa-a3f5-befd3ea8382b', 'volume_name': 'volume-52835d79-b118-49fa-a3f5-befd3ea8382b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ccb804-b90a-40ac-ad4e-3667f63c35fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ccb804-b90a-40ac-ad4e-3667f63c35fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73432361-d8ce-4953-8d51-c144d7b41878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:31 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Volume 52835d79-b118-49fa-a3f5-befd3ea8382b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52835d79-b118-49fa-a3f5-befd3ea8382b', 'volume_size': 1}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Created reservations ['a2dae0f1-e6f8-493a-87a9-749079070ecf', '1b8fac8e-d535-4b02-a5fa-96d9847f8f74', '47709efa-b108-45e3-a4ba-20e6c3eb816f', 'b54f56ef-ea36-4eb0-b987-04852c3defea'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Flow 'volume_create_manager' (79e141b4-2f58-4511-9455-ff2a3fecfae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ce9ebb-ca55-4feb-a96e-968f60aed301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ce9ebb-ca55-4feb-a96e-968f60aed301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-454798246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de72ed8-0830-437e-ae50-aca0eb70d9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae5651fd4d24225837848eaef60ee94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:32Z,use_quota=True,user_id='6d54a2c5b4d64556be6a3a79a894cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512a1e78-1461-4b92-9bad-4559215de57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512a1e78-1461-4b92-9bad-4559215de57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff06c8f9-6158-4133-ba3c-461b7da5919e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff06c8f9-6158-4133-ba3c-461b7da5919e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de72ed8-0830-437e-ae50-aca0eb70d9f1', 'volume_name': 'volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf39e1c1-276b-4589-adf0-d19a903e1ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf39e1c1-276b-4589-adf0-d19a903e1ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8e0c3e-f8a0-40f9-86df-fc29f5d4e045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:31 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Volume 5de72ed8-0830-437e-ae50-aca0eb70d9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1', 'volume_size': 1}
Jul 07 23:01:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:31 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Delete snapshot completed successfully.
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5ff7b0a4-e2a1-45c6-96b6-ab8bae5e7ef0 tempest-CinderUnicodeTest-355648430 None] Lock "cinder-fa701466-9965-47a9-bcee-e233675d64d7-delete_snapshot" released by "delete_snapshot" :: held 4.929s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:32 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.806s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Deleted volume successfully.
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1743416f-f538-478c-b64a-352b7108da34 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-9ed069eb-603f-42a5-8deb-69fcf8dc67b2-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:32 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b" returned: 0 in 0.886s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] <== create_volume: return (2405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.408s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.940s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1407179100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631bd770-7641-443b-b44e-ff98fbd4d7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae5651fd4d24225837848eaef60ee94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:30Z,use_quota=True,user_id='6d54a2c5b4d64556be6a3a79a894cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Creating volume 631bd770-7641-443b-b44e-ff98fbd4d7fc {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:32 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:32 devstack sudo[106673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc 1073741824
Jul 07 23:01:32 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d04b08-1bff-4cac-a5af-9f0e91d45ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f605f4d7-cea6-49a4-9c8f-19361c0a0936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-4adf8cc5-6265-4185-9acf-927c567526e6-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "cinder-cf15755c-2ed1-4230-b131-e25ecc3108e5-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:32 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Volume volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b (310ebb97-d0c8-4690-80cb-4c7d7c26369b): created successfully
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f605f4d7-cea6-49a4-9c8f-19361c0a0936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Flow 'volume_create_manager' (72bbda2f-f2f2-4f10-8de4-85954c06f779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-4adf8cc5-6265-4185-9acf-927c567526e6-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-69491895-5d81-4f1f-9f31-8540ef047f98 tempest-CreateVolumesFromImageTest-807670710 None] Created volume successfully.
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Lock "cinder-cf15755c-2ed1-4230-b131-e25ecc3108e5-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-quobyte-4adf8cc5-6265-4185-9acf-927c567526e6" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "cinder-quobyte-cf15755c-2ed1-4230-b131-e25ecc3108e5" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-4adf8cc5-6265-4185-9acf-927c567526e6" acquired by "delete_volume" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Lock "cinder-quobyte-cf15755c-2ed1-4230-b131-e25ecc3108e5" acquired by "delete_volume" :: waited 0.035s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[827f3441-c700-4e36-8f87-dae7af1600ad]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4064435-655c-4e67-9019-fe36681541c6]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:32 devstack sudo[106675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6
Jul 07 23:01:32 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:32 devstack sudo[106676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5
Jul 07 23:01:32 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:33 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc 1073741824" returned: 0 in 1.071s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:33 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc
Jul 07 23:01:33 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:33 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6" returned: 0 in 0.837s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:33 devstack sudo[106689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6
Jul 07 23:01:33 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:33 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5" returned: 0 in 1.081s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:33 devstack sudo[106693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5
Jul 07 23:01:33 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:34 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4adf8cc5-6265-4185-9acf-927c567526e6" returned: 0 in 0.691s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-4adf8cc5-6265-4185-9acf-927c567526e6" released by "delete_volume" :: held 1.616s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created reservations ['25b4b405-5e7b-483e-9212-f7cd8915c50c', '11475e42-e5ea-4847-ad1b-9b36da647a5d', '1fb53afd-b35a-40e8-8bfe-0718ada0a752', '80c754f9-ce27-4da4-8438-2365ce2cf09c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:34 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc" returned: 0 in 0.861s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] <== create_volume: return (1988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.368s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-211873109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208e3c16-96bd-4e33-a4af-93672d15ab5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae5651fd4d24225837848eaef60ee94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:31Z,use_quota=True,user_id='6d54a2c5b4d64556be6a3a79a894cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Creating volume 208e3c16-96bd-4e33-a4af-93672d15ab5c {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:34 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fddec198-417a-401d-9b2e-88548878cea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631bd770-7641-443b-b44e-ff98fbd4d7fc', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:34 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c 1073741824
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce1b4e7-cd17-4032-be18-677c97c51f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:34 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:34 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Volume volume-631bd770-7641-443b-b44e-ff98fbd4d7fc (631bd770-7641-443b-b44e-ff98fbd4d7fc): created successfully
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce1b4e7-cd17-4032-be18-677c97c51f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Flow 'volume_create_manager' (f931383c-b7ef-44e9-b382-81f356776d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:34 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d3c11bf7-f2f0-4523-8c37-40a938d4a7b6 tempest-CreateVolumesFromImageTest-807670710 None] Created volume successfully.
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:34 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cf15755c-2ed1-4230-b131-e25ecc3108e5" returned: 0 in 0.756s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:34 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:34 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Lock "cinder-quobyte-cf15755c-2ed1-4230-b131-e25ecc3108e5" released by "delete_volume" :: held 1.928s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Created reservations ['362ecbc5-a180-4a7f-8329-5a210094ddf2', 'dd9d662c-b3cc-4a69-b188-297050e85c8e', '45317fc4-85b9-4b66-b773-2760d0ba5513', 'ab787aec-571c-4902-aee2-a0382a2d5b1c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-d846b362-eb84-4be8-8728-67c286e4cdd9-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:34 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:34 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-d846b362-eb84-4be8-8728-67c286e4cdd9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Acquiring lock "cinder-4474a538-9444-42bb-93d9-57cf0d900cf0-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-quobyte-d846b362-eb84-4be8-8728-67c286e4cdd9" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Lock "cinder-4474a538-9444-42bb-93d9-57cf0d900cf0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-d846b362-eb84-4be8-8728-67c286e4cdd9" acquired by "delete_volume" :: waited 0.053s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[39169535-ffea-4982-9b02-e592c338a688]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Acquiring lock "cinder-quobyte-4474a538-9444-42bb-93d9-57cf0d900cf0" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Lock "cinder-quobyte-4474a538-9444-42bb-93d9-57cf0d900cf0" acquired by "delete_volume" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[739e8034-4040-4786-8ec7-35af9159f363]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:35 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9
Jul 07 23:01:35 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:35 devstack sudo[106708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0
Jul 07 23:01:35 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:35 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.039s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:35 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Deleted volume successfully.
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3a4214d-da62-49a1-9d47-6ae183260ab6 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-4adf8cc5-6265-4185-9acf-927c567526e6-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:35 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c 1073741824" returned: 0 in 1.307s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:35 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c
Jul 07 23:01:35 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:35 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.019s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:35 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Deleted volume successfully.
Jul 07 23:01:35 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-102a175a-9463-4642-925f-3179ecf6c777 tempest-CinderUnicodeTest-355648430 None] Lock "cinder-cf15755c-2ed1-4230-b131-e25ecc3108e5-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:36 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:36 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0" returned: 0 in 0.997s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9" returned: 0 in 1.125s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:36 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0
Jul 07 23:01:36 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:36 devstack sudo[106722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9
Jul 07 23:01:36 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:36 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c" returned: 0 in 0.749s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.859s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aa38d4c-974e-4147-9832-829a5561ca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208e3c16-96bd-4e33-a4af-93672d15ab5c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4151d4c3-a2f0-425e-b75f-2d2fcbf5ac87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Creating offline snapshot 4872519a-d058-45d1-8295-7ae63924ddbb of volume 533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:01:36 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Volume volume-208e3c16-96bd-4e33-a4af-93672d15ab5c (208e3c16-96bd-4e33-a4af-93672d15ab5c): created successfully
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4151d4c3-a2f0-425e-b75f-2d2fcbf5ac87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Flow 'volume_create_manager' (a44f5bee-c4fa-418f-a6de-c0f190774611) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a5bd6d-0bf4-49f5-b0fe-5be636203bfc]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:36 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-bd83b609-473f-4b87-a7c4-d0be4c917ff3 tempest-CreateVolumesFromImageTest-807670710 None] Created volume successfully.
Jul 07 23:01:36 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287
Jul 07 23:01:36 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:36 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-d846b362-eb84-4be8-8728-67c286e4cdd9" returned: 0 in 0.709s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-d846b362-eb84-4be8-8728-67c286e4cdd9" released by "delete_volume" :: held 1.913s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:36 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4474a538-9444-42bb-93d9-57cf0d900cf0" returned: 0 in 0.807s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created reservations ['e86a3cb2-b0bc-41b2-aaeb-af1e3cb17c0a', '1904842a-8299-4698-9d40-9a151e9449c9', '6d4df462-3f1c-4a10-9e27-e9d54b7d6a9b', '7a5e6637-a0f5-423b-84a9-8cd098e74e75'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Lock "cinder-quobyte-4474a538-9444-42bb-93d9-57cf0d900cf0" released by "delete_volume" :: held 1.870s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Created reservations ['3ab3557d-133c-46eb-b034-f724865254bf', 'a3fb6584-065d-4926-b146-52da5420f273', 'b5ddba35-2a8c-41e9-a507-ddf412301c7d', 'ab0d39b7-32dc-440c-9623-e8521785cf09'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:37 devstack sudo[106730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:37 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:37 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:37 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:37 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287" returned: 0 in 0.893s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:37 devstack sudo[106737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb 1G
Jul 07 23:01:37 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:37 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.717s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Deleted volume successfully.
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-8094a68a-de0f-419c-9691-0eb9c599d5f4 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-d846b362-eb84-4be8-8728-67c286e4cdd9-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:37 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.719s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Deleted volume successfully.
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-641e8683-681a-47b3-96ea-168a3bb178cb tempest-CinderUnicodeTest-355648430 None] Lock "cinder-4474a538-9444-42bb-93d9-57cf0d900cf0-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-quobyte-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-quobyte-d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Deleting offline snapshot d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd of volume 08ad6451-e7e1-48fc-8cb4-807a8aa745fc {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] snapshot_file for this snap is: volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb7848-0575-46bd-bbef-00cd1b44d03c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:38 devstack sudo[106744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd
Jul 07 23:01:38 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:38 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb 1G" returned: 0 in 0.931s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533eeddc-991d-4b0b-aaee-e20d65db0287 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:38 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533eeddc-991d-4b0b-aaee-e20d65db0287 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb
Jul 07 23:01:38 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:38 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd" returned: 0 in 0.813s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[620e286f-6b91-4773-a59c-cc2c3597cdc0]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:39 devstack sudo[106754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc
Jul 07 23:01:39 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:39 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-533eeddc-991d-4b0b-aaee-e20d65db0287 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb" returned: 0 in 0.834s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:39 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb is being set with open permissions: ugo+rw
Jul 07 23:01:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:39 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb
Jul 07 23:01:39 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:39 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" returned: 0 in 0.916s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:39 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd
Jul 07 23:01:39 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:39 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb" returned: 0 in 0.755s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:39 devstack sudo[106766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.info
Jul 07 23:01:39 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:40 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd" returned: 0 in 0.844s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:40 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd
Jul 07 23:01:40 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:40 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.info" returned: 0 in 0.756s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:40 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.info is being set with open permissions: ugo+rw
Jul 07 23:01:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:40 devstack sudo[106774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.info
Jul 07 23:01:40 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:41 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc.d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd" returned: 0 in 0.733s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:41 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.info" returned: 0 in 0.737s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.100s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd" released by "_delete_snapshot" :: held 3.445s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.761s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-656075538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52835d79-b118-49fa-a3f5-befd3ea8382b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae5651fd4d24225837848eaef60ee94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:31Z,use_quota=True,user_id='6d54a2c5b4d64556be6a3a79a894cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Creating volume 52835d79-b118-49fa-a3f5-befd3ea8382b {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:41 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:41 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b 1073741824
Jul 07 23:01:41 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" released by "delete_snapshot" :: held 3.508s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:41 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4a67426c-741e-497a-946d-8912f3aff9f8 tempest-VolumeDependencyTests-487528879 None] Create snapshot completed successfully
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created reservations ['b4739d5f-f166-4ec5-b272-0196be53fdfa', '90721fde-2d74-4269-85b0-4a4a9b3b5fbd', '9e3b6f07-075b-4467-970b-ea59f9637499', 'cfcd9f31-eb85-4cc7-b464-f8544245ae06'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:41 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Delete snapshot completed successfully.
Jul 07 23:01:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4401ef93-356c-4ead-8193-77ebf58bae98 tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-d64c1e3a-bfb2-4ff1-ba75-ce74ce69babd-delete_snapshot" released by "delete_snapshot" :: held 3.711s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bdceaf2-ce69-4d8d-989c-85afd9d77e1f tempest-ProjectAdminTests-615272579 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7463302612305, 'free_capacity_gb': 1775.7463302612305, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88077) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-08ad6451-e7e1-48fc-8cb4-807a8aa745fc-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-08ad6451-e7e1-48fc-8cb4-807a8aa745fc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "cinder-quobyte-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" acquired by "delete_volume" :: waited 0.032s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0dfa5c2-5b3c-4902-ac6c-8a4a3632be23]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Flow 'volume_create_manager' (71d19a65-5d6a-4b5e-be10-69b3f6a7b8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae16f244-d458-48a5-a5d1-293a8451611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:42 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b 1073741824" returned: 0 in 1.060s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae16f244-d458-48a5-a5d1-293a8451611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1615575997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a791f987-fe87-40d2-9262-d12da96d0227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598377dd37c64462a3b040bb38f8830e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4872519a-d058-45d1-8295-7ae63924ddbb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:42Z,use_quota=True,user_id='f45f2f35ed7a4aff870939765796433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b6278a-1cb6-42de-9f72-26c4e58add3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b6278a-1cb6-42de-9f72-26c4e58add3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6ab1f0-41cd-4e62-9563-d33b90283dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6ab1f0-41cd-4e62-9563-d33b90283dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a791f987-fe87-40d2-9262-d12da96d0227', 'volume_name': 'volume-a791f987-fe87-40d2-9262-d12da96d0227', 'volume_size': 1, 'snapshot_id': '4872519a-d058-45d1-8295-7ae63924ddbb'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9e5c15-fe37-4709-9bdb-813c0bd329a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd9e5c15-fe37-4709-9bdb-813c0bd329a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddcbe96-80bc-4d09-83f8-fc1a17cfc3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:42 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Volume a791f987-fe87-40d2-9262-d12da96d0227: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a791f987-fe87-40d2-9262-d12da96d0227', 'volume_size': 1, 'snapshot_id': '4872519a-d058-45d1-8295-7ae63924ddbb'}
Jul 07 23:01:42 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc
Jul 07 23:01:42 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:42 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b
Jul 07 23:01:42 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:43 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" returned: 0 in 0.934s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:43 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b" returned: 0 in 0.793s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.443s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-454798246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de72ed8-0830-437e-ae50-aca0eb70d9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae5651fd4d24225837848eaef60ee94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:32Z,use_quota=True,user_id='6d54a2c5b4d64556be6a3a79a894cb81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Creating volume 5de72ed8-0830-437e-ae50-aca0eb70d9f1 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:43 devstack sudo[106792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc
Jul 07 23:01:43 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:43 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73432361-d8ce-4953-8d51-c144d7b41878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52835d79-b118-49fa-a3f5-befd3ea8382b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56eb5cf1-6a98-4568-89cf-1881caf52119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:43 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1 1073741824
Jul 07 23:01:43 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:43 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Volume volume-52835d79-b118-49fa-a3f5-befd3ea8382b (52835d79-b118-49fa-a3f5-befd3ea8382b): created successfully
Jul 07 23:01:43 devstack sudo[106796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56eb5cf1-6a98-4568-89cf-1881caf52119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:43 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Flow 'volume_create_manager' (9900869e-4e50-4e60-8201-f4b4844309d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-92cbb00f-62a6-40bb-ae4f-4f6fc60be822 tempest-CreateVolumesFromImageTest-807670710 None] Created volume successfully.
Jul 07 23:01:44 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" returned: 0 in 0.904s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-quobyte-08ad6451-e7e1-48fc-8cb4-807a8aa745fc" released by "delete_volume" :: held 1.920s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Created reservations ['f027b111-fa88-4c63-8c29-531c4658d93d', 'f783cdf0-69b7-4998-af18-2b56d20ef415', '7e9d09e7-b9d7-4714-bd3d-c47d66c494b1', '982ee78c-48f9-4dd2-83a1-90d57e94518a'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:44 devstack sudo[106804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:44 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:44 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.073s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:01:44 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1 1073741824" returned: 0 in 1.298s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=145,cinder:UPDATE=196,cinder:INSERT=50,cinder:DELETE=20 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:01:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:44 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1
Jul 07 23:01:44 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:45 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.872s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:45 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Deleted volume successfully.
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=148,cinder:UPDATE=203,cinder:INSERT=52,cinder:DELETE=18 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-123a3fc5-5750-4697-944e-611453f62b0f tempest-CreateVolumesFromSnapshotTest-1725674912 None] Lock "cinder-08ad6451-e7e1-48fc-8cb4-807a8aa745fc-delete_volume" released by "delete_volume" :: held 3.064s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:45 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1" returned: 0 in 0.950s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.188s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Acquiring lock "cinder-quobyte-4872519a-d058-45d1-8295-7ae63924ddbb-a791f987-fe87-40d2-9262-d12da96d0227" by "_create_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e8e0c3e-f8a0-40f9-86df-fc29f5d4e045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c0ba06-346f-4002-b481-2679496ad0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-4872519a-d058-45d1-8295-7ae63924ddbb-a791f987-fe87-40d2-9262-d12da96d0227" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Creating volume a791f987-fe87-40d2-9262-d12da96d0227 from snapshot 4872519a-d058-45d1-8295-7ae63924ddbb {{(pid=88077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Acquiring lock "cinder-quobyte-a791f987-fe87-40d2-9262-d12da96d0227" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-a791f987-fe87-40d2-9262-d12da96d0227" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] snapshot: 4872519a-d058-45d1-8295-7ae63924ddbb, volume: a791f987-fe87-40d2-9262-d12da96d0227,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 23:01:45 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Volume volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1 (5de72ed8-0830-437e-ae50-aca0eb70d9f1): created successfully
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c0ba06-346f-4002-b481-2679496ad0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Flow 'volume_create_manager' (79e141b4-2f58-4511-9455-ff2a3fecfae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:45 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a067fdeb-c152-4f4f-b539-9eaec1541a0d tempest-CreateVolumesFromImageTest-807670710 None] Created volume successfully.
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64e17b4-1502-4c2e-ba96-8f241498b756]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:46 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb
Jul 07 23:01:46 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "cinder-5de72ed8-0830-437e-ae50-aca0eb70d9f1-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-5de72ed8-0830-437e-ae50-aca0eb70d9f1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "cinder-quobyte-5de72ed8-0830-437e-ae50-aca0eb70d9f1" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-quobyte-5de72ed8-0830-437e-ae50-aca0eb70d9f1" acquired by "delete_volume" :: waited 0.049s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:46 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9dcb91-bd1f-4e8d-b18d-f1892423d12f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:46 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1
Jul 07 23:01:46 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:47 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb" returned: 0 in 1.039s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-533eeddc-991d-4b0b-aaee-e20d65db0287(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:01:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 23:01:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 23:01:47 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[80767a92-9f60-41d5-879f-b51fb9f38b52]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:47 devstack sudo[106823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287
Jul 07 23:01:47 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:47 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1" returned: 0 in 1.043s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:47 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1
Jul 07 23:01:47 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:48 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287" returned: 0 in 1.078s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227 not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:48 devstack sudo[106833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227
Jul 07 23:01:48 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:48 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5de72ed8-0830-437e-ae50-aca0eb70d9f1" returned: 0 in 0.746s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-quobyte-5de72ed8-0830-437e-ae50-aca0eb70d9f1" released by "delete_volume" :: held 1.876s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Created reservations ['9ba2dcae-c447-42aa-bbc3-d366aabbf3d8', '4b1a6e96-ada9-477b-9abd-b178c1532e32', '13d7926a-b3dd-480d-ac0c-cc4d5c7fcf08', 'cc8d859b-2fd4-4018-ae3c-22d37f0caab6'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:48 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:48 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "cinder-52835d79-b118-49fa-a3f5-befd3ea8382b-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-52835d79-b118-49fa-a3f5-befd3ea8382b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "cinder-quobyte-52835d79-b118-49fa-a3f5-befd3ea8382b" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-quobyte-52835d79-b118-49fa-a3f5-befd3ea8382b" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:49 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc78bd8-34d5-46c5-b84a-3436a726789d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:49 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b
Jul 07 23:01:49 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:49 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.242s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:49 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:49 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Deleted volume successfully.
Jul 07 23:01:49 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-48d0ce79-b4b9-4fb0-8d23-dcd681f492d2 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-5de72ed8-0830-437e-ae50-aca0eb70d9f1-delete_volume" released by "delete_volume" :: held 3.628s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:51 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b" returned: 0 in 2.016s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:51 devstack sudo[106855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b
Jul 07 23:01:51 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:53 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-52835d79-b118-49fa-a3f5-befd3ea8382b" returned: 0 in 2.066s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-quobyte-52835d79-b118-49fa-a3f5-befd3ea8382b" released by "delete_volume" :: held 4.152s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Created reservations ['51a4d59e-fbe1-4003-8261-c50f6be42009', '3b0ad76e-cb8f-4bc9-a002-384928a5b147', 'c6118efb-5f7e-4e13-8205-c3ac51378488', '2e082225-073c-472a-bacc-3158f19af5eb'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:53 devstack sudo[106859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:53 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "cinder-208e3c16-96bd-4e33-a4af-93672d15ab5c-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-208e3c16-96bd-4e33-a4af-93672d15ab5c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:54 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "cinder-quobyte-208e3c16-96bd-4e33-a4af-93672d15ab5c" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:54 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-quobyte-208e3c16-96bd-4e33-a4af-93672d15ab5c" acquired by "delete_volume" :: waited 0.058s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:54 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31e67f2-407d-4363-9a71-918d0adf46df]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:54 devstack sudo[106861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c
Jul 07 23:01:54 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:55 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227" returned: 0 in 6.930s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[82efa91d-ed7c-4349-97b1-fa2719719476]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:55 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.862s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:55 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Deleted volume successfully.
Jul 07 23:01:55 devstack sudo[106866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287
Jul 07 23:01:55 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1732ec92-efb3-4a7e-9019-46c36e929d28 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-52835d79-b118-49fa-a3f5-befd3ea8382b-delete_volume" released by "delete_volume" :: held 6.544s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:55 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c" returned: 0 in 1.667s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:55 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c
Jul 07 23:01:55 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:56 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287" returned: 0 in 1.446s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 23:01:56 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Converted 1024.00 MB image at 147.67 MB/s
Jul 07 23:01:56 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227 is being set with open permissions: ugo+rw
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:56 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227
Jul 07 23:01:56 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:56 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-208e3c16-96bd-4e33-a4af-93672d15ab5c" returned: 0 in 0.733s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-quobyte-208e3c16-96bd-4e33-a4af-93672d15ab5c" released by "delete_volume" :: held 2.509s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Created reservations ['d7078d41-ea57-44b1-b8c5-936502465529', 'cbfd945b-fda3-4185-a2dd-1c8d23cfbee9', '3382905d-2595-436e-a391-bb73d0ccec87', '4e4dcbf1-7848-48ea-9454-b6197a2776b2'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:56 devstack sudo[106880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:56 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:57 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227" returned: 0 in 0.934s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-a791f987-fe87-40d2-9262-d12da96d0227" released by "_copy_volume_from_snapshot" :: held 11.614s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-4872519a-d058-45d1-8295-7ae63924ddbb-a791f987-fe87-40d2-9262-d12da96d0227" released by "_create_volume_from_snapshot" :: held 11.666s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.705s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "cinder-631bd770-7641-443b-b44e-ff98fbd4d7fc-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddcbe96-80bc-4d09-83f8-fc1a17cfc3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a791f987-fe87-40d2-9262-d12da96d0227', 'volume_size': 1, 'snapshot_id': '4872519a-d058-45d1-8295-7ae63924ddbb'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b7895a-9c0b-4be4-89eb-3b3d25c53ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-631bd770-7641-443b-b44e-ff98fbd4d7fc-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:57 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Volume volume-a791f987-fe87-40d2-9262-d12da96d0227 (a791f987-fe87-40d2-9262-d12da96d0227): created successfully
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b7895a-9c0b-4be4-89eb-3b3d25c53ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Flow 'volume_create_manager' (71d19a65-5d6a-4b5e-be10-69b3f6a7b8ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "cinder-quobyte-631bd770-7641-443b-b44e-ff98fbd4d7fc" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:57 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:57 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-fc6e1bc8-045f-4da6-a7be-a3dd8de3f53a tempest-VolumeDependencyTests-487528879 None] Created volume successfully.
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.918s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:57 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Deleted volume successfully.
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-quobyte-631bd770-7641-443b-b44e-ff98fbd4d7fc" acquired by "delete_volume" :: waited 0.037s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[16847072-9b5c-4c36-9fc4-dd9efe2228b3]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-80d6b49d-719d-44ef-8bc2-c8d192982d40 tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-208e3c16-96bd-4e33-a4af-93672d15ab5c-delete_volume" released by "delete_volume" :: held 3.867s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:57 devstack sudo[106884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc
Jul 07 23:01:57 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Acquiring lock "cinder-4872519a-d058-45d1-8295-7ae63924ddbb-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Lock "cinder-4872519a-d058-45d1-8295-7ae63924ddbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Acquiring lock "cinder-quobyte-533eeddc-991d-4b0b-aaee-e20d65db0287" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-533eeddc-991d-4b0b-aaee-e20d65db0287" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Acquiring lock "cinder-quobyte-4872519a-d058-45d1-8295-7ae63924ddbb" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-4872519a-d058-45d1-8295-7ae63924ddbb" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Deleting offline snapshot 4872519a-d058-45d1-8295-7ae63924ddbb of volume 533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] snapshot_file for this snap is: volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e5c34a-4391-4c02-ae53-03b19329b18c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:58 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb
Jul 07 23:01:58 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:58 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc" returned: 0 in 1.065s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:58 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc
Jul 07 23:01:58 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:59 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb" returned: 0 in 0.979s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-533eeddc-991d-4b0b-aaee-e20d65db0287(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d05327-7f2a-483e-9ccb-0c8b9c7c74f7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:59 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287
Jul 07 23:01:59 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:59 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-631bd770-7641-443b-b44e-ff98fbd4d7fc" returned: 0 in 0.787s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-quobyte-631bd770-7641-443b-b44e-ff98fbd4d7fc" released by "delete_volume" :: held 1.926s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Created reservations ['ce90ef10-a842-4737-970f-3b4c2fa39377', '44a839ac-4931-4f82-baad-3e0aa1f75814', 'e68250c3-9b94-41d4-8ef8-1e8382c6688b', 'f12a79b2-976c-4bd1-b58a-b772e708a30c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:59 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:01:59 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:00 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287" returned: 0 in 1.047s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:00 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb
Jul 07 23:02:00 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:00 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.739s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:00 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Deleted volume successfully.
Jul 07 23:02:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f45264ab-3a71-4903-81f6-21cb037ab68d tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-631bd770-7641-443b-b44e-ff98fbd4d7fc-delete_volume" released by "delete_volume" :: held 3.076s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "cinder-310ebb97-d0c8-4690-80cb-4c7d7c26369b-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-310ebb97-d0c8-4690-80cb-4c7d7c26369b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "cinder-quobyte-310ebb97-d0c8-4690-80cb-4c7d7c26369b" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-quobyte-310ebb97-d0c8-4690-80cb-4c7d7c26369b" acquired by "delete_volume" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:01 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f427d790-4870-48b0-9bd0-6dda21f325c6]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:01 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b
Jul 07 23:02:01 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:01 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb" returned: 0 in 0.854s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:01 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb
Jul 07 23:02:01 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:02 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b" returned: 0 in 0.974s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:02 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287.4872519a-d058-45d1-8295-7ae63924ddbb" returned: 0 in 0.736s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:02 devstack sudo[106920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b
Jul 07 23:02:02 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-4872519a-d058-45d1-8295-7ae63924ddbb" released by "_delete_snapshot" :: held 3.789s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-533eeddc-991d-4b0b-aaee-e20d65db0287" released by "delete_snapshot" :: held 3.832s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Created reservations ['770f86f7-1888-4833-b236-27cc1be09790', '4cb79615-2d8a-4eda-94ba-51deab640196', 'eb88b62f-96be-44ec-8b41-20e7eb7ffe35', 'b245c64a-6a81-4764-a1f7-e83e49c3b715'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Delete snapshot completed successfully.
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-5c841499-4d90-47e2-a64b-8235ad0015ce tempest-VolumeDependencyTests-487528879 None] Lock "cinder-4872519a-d058-45d1-8295-7ae63924ddbb-delete_snapshot" released by "delete_snapshot" :: held 4.077s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Acquiring lock "cinder-533eeddc-991d-4b0b-aaee-e20d65db0287-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Lock "cinder-533eeddc-991d-4b0b-aaee-e20d65db0287-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Acquiring lock "cinder-quobyte-533eeddc-991d-4b0b-aaee-e20d65db0287" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-533eeddc-991d-4b0b-aaee-e20d65db0287" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[96899f82-2933-4787-bee3-9f071f5edaaa]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:02 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-310ebb97-d0c8-4690-80cb-4c7d7c26369b" returned: 0 in 0.827s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-quobyte-310ebb97-d0c8-4690-80cb-4c7d7c26369b" released by "delete_volume" :: held 1.852s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:02 devstack sudo[106923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287
Jul 07 23:02:02 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:02 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Created reservations ['9aad4f51-a2cc-49a7-a751-4458d89690d6', 'e86570dc-48ad-4e23-bbd1-32c3d24854f8', '512bf9d9-2347-4fb5-8606-f7b2004447d9', '5443213b-cd49-4f29-9fb9-a65d0bd22db7'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:03 devstack sudo[106925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:02:03 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:03 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287" returned: 0 in 1.198s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:04 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287
Jul 07 23:02:04 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:04 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.067s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:04 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Deleted volume successfully.
Jul 07 23:02:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-694848c4-2ec3-4005-839b-7fd16ce1c38f tempest-CreateVolumesFromImageTest-807670710 None] Lock "cinder-310ebb97-d0c8-4690-80cb-4c7d7c26369b-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:04 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-533eeddc-991d-4b0b-aaee-e20d65db0287" returned: 0 in 0.943s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-533eeddc-991d-4b0b-aaee-e20d65db0287" released by "delete_volume" :: held 2.233s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:05 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Created reservations ['034808b8-97e5-403f-a3cb-d3fbf0877a2f', '0f355382-6fe1-4259-a3bc-0af2b90387dd', '1349fed4-3910-4710-ac90-38d1b939205d', '422813b5-9ce8-4e8d-b86e-3dac953af01c'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:05 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:05 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:02:05 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:05 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.722s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:05 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:05 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Deleted volume successfully.
Jul 07 23:02:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc451939-26a3-4f45-a029-1fcf2cfe972f tempest-VolumeDependencyTests-487528879 None] Lock "cinder-533eeddc-991d-4b0b-aaee-e20d65db0287-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Acquiring lock "cinder-a791f987-fe87-40d2-9262-d12da96d0227-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Lock "cinder-a791f987-fe87-40d2-9262-d12da96d0227-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Acquiring lock "cinder-quobyte-a791f987-fe87-40d2-9262-d12da96d0227" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:06 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-a791f987-fe87-40d2-9262-d12da96d0227" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:06 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ee9e06-5b72-438b-bd47-0ccf0001b973]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:06 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227
Jul 07 23:02:06 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:07 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227" returned: 0 in 1.107s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:07 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227
Jul 07 23:02:07 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:08 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-a791f987-fe87-40d2-9262-d12da96d0227" returned: 0 in 0.805s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Lock "cinder-quobyte-a791f987-fe87-40d2-9262-d12da96d0227" released by "delete_volume" :: held 1.982s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:08 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Created reservations ['5e4e025c-2a20-4bc5-aecd-327bc1c5bb81', 'd55398ad-2540-41e0-8d88-ce021637ac61', '48cc67a5-f70a-4a89-b4b0-dea5a2762f4b', 'be194451-93bf-4176-9112-cf94dc45f4bc'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:08 devstack sudo[106945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:02:08 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:09 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.945s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:09 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:09 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Deleted volume successfully.
Jul 07 23:02:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2151a4c5-d8bd-4633-82c2-4c1eaf5ab14a tempest-VolumeDependencyTests-487528879 None] Lock "cinder-a791f987-fe87-40d2-9262-d12da96d0227-delete_volume" released by "delete_volume" :: held 3.425s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:11 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Flow 'volume_create_manager' (ab468ab3-a27e-4508-b344-0e7424588606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8091edb8-449c-4441-aa3d-ee7c484da90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8091edb8-449c-4441-aa3d-ee7c484da90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4907e649-164d-4b85-9aab-59b92e0d16af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e1a73f65e704b4180f089f8ae43e49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:11Z,use_quota=True,user_id='7ab3a42fbdac44aa91171784dcaa15cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ba24ab-d46f-49df-88b1-bbc3d945ccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ba24ab-d46f-49df-88b1-bbc3d945ccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:11 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f92e20c-6f23-4420-8616-818765ed6be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:11 devstack cinder-volume[88077]: DEBUG cinder.image.glance [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Creating Keystone auth plugin from conf {{(pid=88077) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 23:02:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f92e20c-6f23-4420-8616-818765ed6be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4907e649-164d-4b85-9aab-59b92e0d16af', 'volume_name': 'volume-4907e649-164d-4b85-9aab-59b92e0d16af', 'volume_size': 1, 'image_id': 'd1e1940f-2e8c-412e-b714-03f447b67e29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e1940f-2e8c-412e-b714-03f447b67e29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89ac302b62862dbd0b69b1c94e2ddf18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e1a73f65e704b4180f089f8ae43e49e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '690e8e2377a7b2d2505759708d3fa7abbb5d9462be5cfd251ff72e5ba3f701d83460eb730b409ce7600de76e35d50eae2f979a7b79bba2d6b0e9be749d71d9b1', 'id': 'd1e1940f-2e8c-412e-b714-03f447b67e29', 'created_at': datetime.datetime(2026, 7, 7, 21, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e1940f-2e8c-412e-b714-03f447b67e29/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72a74a10>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34840184-c326-4556-a93d-f7bf4046d625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34840184-c326-4556-a93d-f7bf4046d625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:12 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36068450-3778-4720-9dd3-378a3f46683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:12 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Volume 4907e649-164d-4b85-9aab-59b92e0d16af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4907e649-164d-4b85-9aab-59b92e0d16af', 'volume_size': 1, 'image_id': 'd1e1940f-2e8c-412e-b714-03f447b67e29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e1940f-2e8c-412e-b714-03f447b67e29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89ac302b62862dbd0b69b1c94e2ddf18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e1a73f65e704b4180f089f8ae43e49e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '690e8e2377a7b2d2505759708d3fa7abbb5d9462be5cfd251ff72e5ba3f701d83460eb730b409ce7600de76e35d50eae2f979a7b79bba2d6b0e9be749d71d9b1', 'id': 'd1e1940f-2e8c-412e-b714-03f447b67e29', 'created_at': datetime.datetime(2026, 7, 7, 21, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e1940f-2e8c-412e-b714-03f447b67e29/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72a74a10>}
Jul 07 23:02:12 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Trying to clone 4907e649-164d-4b85-9aab-59b92e0d16af from image d1e1940f-2e8c-412e-b714-03f447b67e29 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1e1940f-2e8c-412e-b714-03f447b67e29', 'metadata': {}}]). {{(pid=88077) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 23:02:12 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 23:02:12 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 23:02:12 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc49d71-3f50-43ab-a814-6ab778e07b12]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:12 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD
Jul 07 23:02:12 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Flow 'volume_create_manager' (1abac21f-1019-462f-ab4f-273b1d67275d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0e5f95-b443-4e9b-945c-35420aee1d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa0e5f95-b443-4e9b-945c-35420aee1d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41138744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8e8543-c820-4afb-9039-bbbbd717352f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2850909f93b84e1e8e3343e8618b2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:13Z,use_quota=True,user_id='e967bb293fd646a3b42da01c1bcbed2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3d000a-3f04-41d5-89eb-6fbe6cd441cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b3d000a-3f04-41d5-89eb-6fbe6cd441cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220a97ec-1433-49ea-a7e8-29bad2b59e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220a97ec-1433-49ea-a7e8-29bad2b59e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8e8543-c820-4afb-9039-bbbbd717352f', 'volume_name': 'volume-0f8e8543-c820-4afb-9039-bbbbd717352f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38f2424-3d62-4b83-bb3b-339931c0595a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b38f2424-3d62-4b83-bb3b-339931c0595a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70684133-ad20-4c12-87d3-2914be04af77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:13 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Volume 0f8e8543-c820-4afb-9039-bbbbd717352f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8e8543-c820-4afb-9039-bbbbd717352f', 'volume_size': 1}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-41138744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8e8543-c820-4afb-9039-bbbbd717352f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2850909f93b84e1e8e3343e8618b2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:13Z,use_quota=True,user_id='e967bb293fd646a3b42da01c1bcbed2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Creating volume 0f8e8543-c820-4afb-9039-bbbbd717352f {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:13 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:13 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f 1073741824
Jul 07 23:02:13 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:13 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD" returned: 0 in 1.050s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:13 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD
Jul 07 23:02:13 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:14 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD" returned: 1 in 0.941s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:02:14 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Temporary image d1e1940f-2e8c-412e-b714-03f447b67e29 is fetched for user 7ab3a42fbdac44aa91171784dcaa15cc. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 23:02:14 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbee7d3-51b0-456a-aba2-f178a3c84f95]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:14 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD
Jul 07 23:02:14 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:14 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f 1073741824" returned: 0 in 1.281s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:14 devstack sudo[106968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f
Jul 07 23:02:14 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:15 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD" returned: 0 in 0.860s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:15 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD
Jul 07 23:02:15 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:15 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f" returned: 0 in 0.911s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] <== create_volume: return (2251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.254s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70684133-ad20-4c12-87d3-2914be04af77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8e8543-c820-4afb-9039-bbbbd717352f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25802d9b-19aa-44f2-9815-a671ffe8f6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:15 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Volume volume-0f8e8543-c820-4afb-9039-bbbbd717352f (0f8e8543-c820-4afb-9039-bbbbd717352f): created successfully
Jul 07 23:02:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25802d9b-19aa-44f2-9815-a671ffe8f6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:15 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Flow 'volume_create_manager' (1abac21f-1019-462f-ab4f-273b1d67275d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:15 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-a36ee291-afa0-44ba-ac4e-ce3bc51fffc1 tempest-ProjectReaderTests-208816541 None] Created volume successfully.
Jul 07 23:02:16 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD" returned: 1 in 1.012s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4907e649-164d-4b85-9aab-59b92e0d16af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e1a73f65e704b4180f089f8ae43e49e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:11Z,use_quota=True,user_id='7ab3a42fbdac44aa91171784dcaa15cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Creating volume 4907e649-164d-4b85-9aab-59b92e0d16af {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:16 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:02:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:16 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af 1073741824
Jul 07 23:02:16 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Acquiring lock "cinder-0f8e8543-c820-4afb-9039-bbbbd717352f-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Lock "cinder-0f8e8543-c820-4afb-9039-bbbbd717352f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Acquiring lock "cinder-quobyte-0f8e8543-c820-4afb-9039-bbbbd717352f" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Lock "cinder-quobyte-0f8e8543-c820-4afb-9039-bbbbd717352f" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:17 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[365e442c-f024-4368-9b87-3d042e393738]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:17 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f
Jul 07 23:02:17 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:17 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af 1073741824" returned: 0 in 1.305s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:17 devstack sudo[106988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af
Jul 07 23:02:17 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:18 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f" returned: 0 in 1.254s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:18 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af" returned: 0 in 0.846s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:18 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f
Jul 07 23:02:18 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:18 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Attempting download of d1e1940f-2e8c-412e-b714-03f447b67e29 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e1940f-2e8c-412e-b714-03f447b67e29', 'metadata': {}}])) to volume 4907e649-164d-4b85-9aab-59b92e0d16af. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 23:02:18 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a97ef9f-99fe-4b8e-a762-fdd26d17b04d]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e1940f-2e8c-412e-b714-03f447b67e29_v5oa5c2c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:18 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e1940f-2e8c-412e-b714-03f447b67e29_v5oa5c2c
Jul 07 23:02:18 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:19 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-0f8e8543-c820-4afb-9039-bbbbd717352f" returned: 0 in 0.889s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Lock "cinder-quobyte-0f8e8543-c820-4afb-9039-bbbbd717352f" released by "delete_volume" :: held 2.212s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Created reservations ['17fae7d1-eb50-47b7-b5e3-11a333b396ea', '7ae2b3c1-eca7-4b5e-bde8-af3efa10696d', 'a62f2a5a-31b0-493b-a89c-ea9a0e180cda', 'b097bf62-73ec-4ea5-9796-bd14a9f15a61'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:19 devstack sudo[107002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:02:19 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:19 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1e1940f-2e8c-412e-b714-03f447b67e29_v5oa5c2c" returned: 0 in 1.050s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e1940f-2e8c-412e-b714-03f447b67e29_v5oa5c2c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:19 devstack sudo[107004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e1940f-2e8c-412e-b714-03f447b67e29_v5oa5c2c
Jul 07 23:02:19 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:20 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.846s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:20 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:20 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Deleted volume successfully.
Jul 07 23:02:20 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-316be9eb-e294-4d4e-8947-72020e365055 tempest-ProjectReaderTests-208816541 None] Lock "cinder-0f8e8543-c820-4afb-9039-bbbbd717352f-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:20 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e1940f-2e8c-412e-b714-03f447b67e29_v5oa5c2c" returned: 1 in 0.923s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1e1940f-2e8c-412e-b714-03f447b67e29_v5oa5c2c' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:02:20 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71db08c-7874-41c2-91f0-6b7e79414b31]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:20 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD
Jul 07 23:02:20 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Flow 'volume_create_manager' (598ada1d-a5f2-413e-90f9-0f7d0ab1c76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e886dae6-9c0a-4a23-9843-63989e91e1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e886dae6-9c0a-4a23-9843-63989e91e1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743999052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48015ceb-fc84-4153-88a9-b8eaf886404f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2850909f93b84e1e8e3343e8618b2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:21Z,use_quota=True,user_id='e967bb293fd646a3b42da01c1bcbed2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cab6850-64a0-4883-a9d2-5e0ff167bcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cab6850-64a0-4883-a9d2-5e0ff167bcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85798b90-9cb8-49c2-9645-f6f53d7b10bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85798b90-9cb8-49c2-9645-f6f53d7b10bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48015ceb-fc84-4153-88a9-b8eaf886404f', 'volume_name': 'volume-48015ceb-fc84-4153-88a9-b8eaf886404f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f528f07a-ce7f-4817-8385-9f9c68b51513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f528f07a-ce7f-4817-8385-9f9c68b51513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79401ae1-1894-432a-8efb-7626ff653e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:21 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Volume 48015ceb-fc84-4153-88a9-b8eaf886404f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48015ceb-fc84-4153-88a9-b8eaf886404f', 'volume_size': 1}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743999052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48015ceb-fc84-4153-88a9-b8eaf886404f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2850909f93b84e1e8e3343e8618b2af1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:21Z,use_quota=True,user_id='e967bb293fd646a3b42da01c1bcbed2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Creating volume 48015ceb-fc84-4153-88a9-b8eaf886404f {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:21 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:21 devstack sudo[107012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f 1073741824
Jul 07 23:02:21 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:21 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD" returned: 0 in 0.850s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:21 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD
Jul 07 23:02:21 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:22 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f 1073741824" returned: 0 in 1.262s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:22 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD" returned: 1 in 1.131s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:02:22 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] d1e1940f-2e8c-412e-b714-03f447b67e29 was raw, converting to raw {{(pid=88077) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 23:02:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:22 devstack sudo[107025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af
Jul 07 23:02:22 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:22 devstack sudo[107026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f
Jul 07 23:02:22 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:23 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f" returned: 0 in 0.824s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.180s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79401ae1-1894-432a-8efb-7626ff653e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48015ceb-fc84-4153-88a9-b8eaf886404f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db4d1c7-3dc9-4772-9f7b-a57b23732abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:23 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Volume volume-48015ceb-fc84-4153-88a9-b8eaf886404f (48015ceb-fc84-4153-88a9-b8eaf886404f): created successfully
Jul 07 23:02:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db4d1c7-3dc9-4772-9f7b-a57b23732abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:23 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Flow 'volume_create_manager' (598ada1d-a5f2-413e-90f9-0f7d0ab1c76f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:23 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9cffb8db-2849-446d-80ce-43cd14f556c2 tempest-ProjectReaderTests-208816541 None] Created volume successfully.
Jul 07 23:02:23 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af" returned: 0 in 0.984s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:23 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1e1940f-2e8c-412e-b714-03f447b67e29_u7mkmgmkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 23:02:23 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 23:02:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:23 devstack sudo[107033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af 1G
Jul 07 23:02:23 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Acquiring lock "cinder-48015ceb-fc84-4153-88a9-b8eaf886404f-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Lock "cinder-48015ceb-fc84-4153-88a9-b8eaf886404f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Acquiring lock "cinder-quobyte-48015ceb-fc84-4153-88a9-b8eaf886404f" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Lock "cinder-quobyte-48015ceb-fc84-4153-88a9-b8eaf886404f" acquired by "delete_volume" :: waited 0.037s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:24 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af 1G" returned: 0 in 1.122s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:24 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f4a4c3-a602-41b3-bf58-ac9710068f03]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:24 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e576379-35ff-493c-baa0-0cbe818a6ab8]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:24 devstack sudo[107053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f
Jul 07 23:02:24 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:25 devstack sudo[107074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af
Jul 07 23:02:25 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:26 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f" returned: 0 in 1.269s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:26 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f
Jul 07 23:02:26 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:26 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af" returned: 0 in 1.506s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:26 devstack sudo[107088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af
Jul 07 23:02:26 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:26 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-48015ceb-fc84-4153-88a9-b8eaf886404f" returned: 0 in 0.904s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Lock "cinder-quobyte-48015ceb-fc84-4153-88a9-b8eaf886404f" released by "delete_volume" :: held 2.244s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Created reservations ['85dc703b-8033-49ef-a90e-ce528ec8c06b', 'e877282c-a801-460f-b167-96c0e1eefa88', 'eac70f36-515d-4f23-a6f4-1817193227d4', '2f73dfbb-bf91-4302-b955-40892c3fa0ac'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:27 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:02:27 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:27 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af" returned: 1 in 1.194s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Downloaded image d1e1940f-2e8c-412e-b714-03f447b67e29 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1e1940f-2e8c-412e-b714-03f447b67e29', 'metadata': {}}])) to volume 4907e649-164d-4b85-9aab-59b92e0d16af successfully. {{(pid=88077) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Temporary image d1e1940f-2e8c-412e-b714-03f447b67e29 for user 7ab3a42fbdac44aa91171784dcaa15cc is deleted. {{(pid=88077) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.volume.volume_utils [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Marking volume 4907e649-164d-4b85-9aab-59b92e0d16af as bootable. {{(pid=88077) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Copying metadata from image d1e1940f-2e8c-412e-b714-03f447b67e29 to 4907e649-164d-4b85-9aab-59b92e0d16af. {{(pid=88077) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Creating volume glance metadata for volume 4907e649-164d-4b85-9aab-59b92e0d16af backed by image d1e1940f-2e8c-412e-b714-03f447b67e29 with: {'image_id': 'd1e1940f-2e8c-412e-b714-03f447b67e29', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '89ac302b62862dbd0b69b1c94e2ddf18', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88077) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36068450-3778-4720-9dd3-378a3f46683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4907e649-164d-4b85-9aab-59b92e0d16af', 'volume_size': 1, 'image_id': 'd1e1940f-2e8c-412e-b714-03f447b67e29', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1e1940f-2e8c-412e-b714-03f447b67e29', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '89ac302b62862dbd0b69b1c94e2ddf18', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e1a73f65e704b4180f089f8ae43e49e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '690e8e2377a7b2d2505759708d3fa7abbb5d9462be5cfd251ff72e5ba3f701d83460eb730b409ce7600de76e35d50eae2f979a7b79bba2d6b0e9be749d71d9b1', 'id': 'd1e1940f-2e8c-412e-b714-03f447b67e29', 'created_at': datetime.datetime(2026, 7, 7, 21, 2, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 2, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1e1940f-2e8c-412e-b714-03f447b67e29/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7fad72a74a10>}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0670661c-e03d-4729-ac6a-d92921c227e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:27 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Volume volume-4907e649-164d-4b85-9aab-59b92e0d16af (4907e649-164d-4b85-9aab-59b92e0d16af): created successfully
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0670661c-e03d-4729-ac6a-d92921c227e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:27 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Flow 'volume_create_manager' (ab468ab3-a27e-4508-b344-0e7424588606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-bc862ab4-5b3a-4f29-9378-7c2ae8a575f1 tempest-VolumeImageDependencyTests-1300099688 None] Created volume successfully.
Jul 07 23:02:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Acquiring lock "cinder-4907e649-164d-4b85-9aab-59b92e0d16af-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Lock "cinder-4907e649-164d-4b85-9aab-59b92e0d16af-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Acquiring lock "cinder-quobyte-4907e649-164d-4b85-9aab-59b92e0d16af" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Lock "cinder-quobyte-4907e649-164d-4b85-9aab-59b92e0d16af" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:28 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6b79d5-a642-43fb-8f84-25fe5bc6a09c]: (4, 'raw') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:28 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.315s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:28 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:28 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Deleted volume successfully.
Jul 07 23:02:28 devstack sudo[107097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af
Jul 07 23:02:28 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-50a9b392-cfaf-4038-8d6b-9f3f7bc1015f tempest-ProjectReaderTests-208816541 None] Lock "cinder-48015ceb-fc84-4153-88a9-b8eaf886404f-delete_volume" released by "delete_volume" :: held 3.987s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:29 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af" returned: 0 in 1.369s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:29 devstack sudo[107101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af
Jul 07 23:02:29 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:30 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af" returned: 1 in 1.107s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af' failed. Not Retrying. {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:02:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:30 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af
Jul 07 23:02:30 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Flow 'volume_create_manager' (3e48dcc4-93b0-4cfe-81ae-bfe685fb7231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099d36c0-8546-46b4-97c5-24174726dc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099d36c0-8546-46b4-97c5-24174726dc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-197629127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e50674-422b-46c5-9962-b2d1b6e4859e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667df3f10d0d45bc9842a0ba01a45174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:31Z,use_quota=True,user_id='7a6156f51d234c1a9e2cde52e15f9067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66907b94-115e-4b26-92d3-4a5f186ecfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66907b94-115e-4b26-92d3-4a5f186ecfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c38492c-b134-4443-bb39-e3a30868ad28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c38492c-b134-4443-bb39-e3a30868ad28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e50674-422b-46c5-9962-b2d1b6e4859e', 'volume_name': 'volume-42e50674-422b-46c5-9962-b2d1b6e4859e', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1787954-0517-4bfb-91f3-00062a74cd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1787954-0517-4bfb-91f3-00062a74cd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eab37b5-ff7e-4a53-956b-2c3f0331b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:31 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Volume 42e50674-422b-46c5-9962-b2d1b6e4859e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e50674-422b-46c5-9962-b2d1b6e4859e', 'volume_size': 1}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-197629127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e50674-422b-46c5-9962-b2d1b6e4859e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667df3f10d0d45bc9842a0ba01a45174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:31Z,use_quota=True,user_id='7a6156f51d234c1a9e2cde52e15f9067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Creating volume 42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:31 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:31 devstack sudo[107109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e 1073741824
Jul 07 23:02:31 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:31 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4907e649-164d-4b85-9aab-59b92e0d16af" returned: 0 in 0.909s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Lock "cinder-quobyte-4907e649-164d-4b85-9aab-59b92e0d16af" released by "delete_volume" :: held 3.475s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Created reservations ['234e9b38-62ad-4a57-8e15-6031faf62368', 'd9e6eacb-b781-45eb-b26b-d2776bb7617e', '9ec71f93-48d2-4e81-b3e9-56046a102763', '25a55835-7256-4d76-bdc9-45f770709c3d'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:31 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:02:31 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:32 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e 1073741824" returned: 0 in 0.948s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:32 devstack sudo[107118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e
Jul 07 23:02:32 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:32 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.889s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:32 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:32 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Deleted volume successfully.
Jul 07 23:02:32 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ce5d9093-7485-4698-b79d-c8525d29bd57 tempest-VolumeImageDependencyTests-1300099688 None] Lock "cinder-4907e649-164d-4b85-9aab-59b92e0d16af-delete_volume" released by "delete_volume" :: held 4.630s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:33 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e" returned: 0 in 0.962s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eab37b5-ff7e-4a53-956b-2c3f0331b74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e50674-422b-46c5-9962-b2d1b6e4859e', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611b7604-a3d4-497a-a84c-827063111965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Volume volume-42e50674-422b-46c5-9962-b2d1b6e4859e (42e50674-422b-46c5-9962-b2d1b6e4859e): created successfully
Jul 07 23:02:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611b7604-a3d4-497a-a84c-827063111965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Flow 'volume_create_manager' (3e48dcc4-93b0-4cfe-81ae-bfe685fb7231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e7e17a9d-6a8e-4fc1-9a74-ddba5f2326c3 tempest-SnapshotDependencyTests-1805396188 None] Created volume successfully.
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Flow 'volume_create_manager' (5e55b0ce-24f6-4b94-9fcb-4808e41799a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c09b12a-b9b1-467a-b019-d768a2f7b1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c09b12a-b9b1-467a-b019-d768a2f7b1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-972611027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4374492d-b6bd-45d3-aad2-bcd2a17a5642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632d476354544d3dbf1325b0cf85b3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:34Z,use_quota=True,user_id='95e6ffa4be5e45ba990b459550956f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebae7c7b-72f6-42ba-9edf-2a2c3e8ca274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebae7c7b-72f6-42ba-9edf-2a2c3e8ca274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c15fc19-6907-48ea-b500-0e8610c90e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c15fc19-6907-48ea-b500-0e8610c90e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4374492d-b6bd-45d3-aad2-bcd2a17a5642', 'volume_name': 'volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ee77b7-fae9-4ab3-b9fe-a30e1d5e6795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5ee77b7-fae9-4ab3-b9fe-a30e1d5e6795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218bd255-ad02-4573-98c1-8650cddcbe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:34 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Volume 4374492d-b6bd-45d3-aad2-bcd2a17a5642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642', 'volume_size': 1}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-972611027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4374492d-b6bd-45d3-aad2-bcd2a17a5642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632d476354544d3dbf1325b0cf85b3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:34Z,use_quota=True,user_id='95e6ffa4be5e45ba990b459550956f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Creating volume 4374492d-b6bd-45d3-aad2-bcd2a17a5642 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:34 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:34 devstack sudo[107122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642 1073741824
Jul 07 23:02:34 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:35 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642 1073741824" returned: 0 in 1.056s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:35 devstack sudo[107128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642
Jul 07 23:02:35 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:35 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642" returned: 0 in 0.756s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:35 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.856s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.119s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218bd255-ad02-4573-98c1-8650cddcbe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa6f9df-60c6-460f-9138-65925f761d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Creating offline snapshot 8c5a7e41-2531-44b6-ae3d-3caca7f72df4 of volume 42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:02:36 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Volume volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642 (4374492d-b6bd-45d3-aad2-bcd2a17a5642): created successfully
Jul 07 23:02:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa6f9df-60c6-460f-9138-65925f761d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:36 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Flow 'volume_create_manager' (5e55b0ce-24f6-4b94-9fcb-4808e41799a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:36 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a320305-7428-493f-abb2-d5ae2f0d75a0]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:36 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c93eebf6-fc52-4798-8e6d-cf0fde187d12 tempest-ProjectReaderTests-1563190062 None] Created volume successfully.
Jul 07 23:02:36 devstack sudo[107131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e
Jul 07 23:02:36 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:36 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e" returned: 0 in 0.882s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:36 devstack sudo[107136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 1G
Jul 07 23:02:36 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "cinder-4374492d-b6bd-45d3-aad2-bcd2a17a5642-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-4374492d-b6bd-45d3-aad2-bcd2a17a5642-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "cinder-quobyte-4374492d-b6bd-45d3-aad2-bcd2a17a5642" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-quobyte-4374492d-b6bd-45d3-aad2-bcd2a17a5642" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4fe971-c4e3-47ee-b9e8-bb82037c7df3]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:37 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642
Jul 07 23:02:37 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (8e65e34d-9895-435e-acb7-298837b92108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c34df20-9b2c-46a8-8b6e-887320f99a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c34df20-9b2c-46a8-8b6e-887320f99a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418851635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f750c1ec-c154-45fb-a8fe-d9853a37c9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:38Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c16971-147f-49c8-95e5-06fb01bba466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c16971-147f-49c8-95e5-06fb01bba466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a9e170-f166-472e-a877-c80602c174e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:37 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0a9e170-f166-472e-a877-c80602c174e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f750c1ec-c154-45fb-a8fe-d9853a37c9c4', 'volume_name': 'volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7672d2d5-53c8-4603-8383-66d4a29ebed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7672d2d5-53c8-4603-8383-66d4a29ebed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168f2ae2-284f-4235-b59d-f28e7250f3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:37 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Volume f750c1ec-c154-45fb-a8fe-d9853a37c9c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4', 'volume_size': 1}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 1G" returned: 0 in 1.019s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e50674-422b-46c5-9962-b2d1b6e4859e -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:38 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e50674-422b-46c5-9962-b2d1b6e4859e -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4
Jul 07 23:02:38 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:38 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642" returned: 0 in 0.837s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:38 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642
Jul 07 23:02:38 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:38 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e50674-422b-46c5-9962-b2d1b6e4859e -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4" returned: 0 in 0.755s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:38 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 is being set with open permissions: ugo+rw
Jul 07 23:02:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:38 devstack sudo[107156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4
Jul 07 23:02:38 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:39 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-4374492d-b6bd-45d3-aad2-bcd2a17a5642" returned: 0 in 0.644s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-quobyte-4374492d-b6bd-45d3-aad2-bcd2a17a5642" released by "delete_volume" :: held 1.527s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Created reservations ['a9219a4d-eae7-4514-949c-2b570d12c0a3', '8547b5e4-6de1-492a-8638-dfc6619b56d5', '090275a7-8b7d-45d3-8a8a-d2f8207f0ba8', 'd202030f-c0f9-4ef8-b3dc-8cbcaced0123'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:39 devstack sudo[107160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:02:39 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:39 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4" returned: 0 in 0.702s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:39 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.info
Jul 07 23:02:39 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:40 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.730s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:40 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Deleted volume successfully.
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-219f000e-4804-4746-9625-55ee3e7f5e81 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-4374492d-b6bd-45d3-aad2-bcd2a17a5642-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:40 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.info" returned: 0 in 0.765s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:40 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.info is being set with open permissions: ugo+rw
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:40 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.info
Jul 07 23:02:40 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Flow 'volume_create_manager' (25ad16de-9848-40a3-8507-37b45ed5d356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3bd023-062c-4cbc-8424-9ab2ba181354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3bd023-062c-4cbc-8424-9ab2ba181354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1703719832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21aa99d1-cdfe-43ca-a133-70451686d37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632d476354544d3dbf1325b0cf85b3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:40Z,use_quota=True,user_id='95e6ffa4be5e45ba990b459550956f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33fbad3-0905-47ce-ab76-8e977cffbd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33fbad3-0905-47ce-ab76-8e977cffbd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958c7e01-548f-4b0d-b695-05eacef2115e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958c7e01-548f-4b0d-b695-05eacef2115e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21aa99d1-cdfe-43ca-a133-70451686d37b', 'volume_name': 'volume-21aa99d1-cdfe-43ca-a133-70451686d37b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9eb741-d0d6-4a68-a47b-fb63c40011d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9eb741-d0d6-4a68-a47b-fb63c40011d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a5224b-0cf9-4e07-a8d9-6ee4d8c5c7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:40 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Volume 21aa99d1-cdfe-43ca-a133-70451686d37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21aa99d1-cdfe-43ca-a133-70451686d37b', 'volume_size': 1}
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:40 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.info" returned: 0 in 0.738s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.032s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418851635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f750c1ec-c154-45fb-a8fe-d9853a37c9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:38Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Creating volume f750c1ec-c154-45fb-a8fe-d9853a37c9c4 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:41 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:41 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 1073741824
Jul 07 23:02:41 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:41 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0b7723e6-f8d4-40b2-82a6-b6b85472cb98 tempest-SnapshotDependencyTests-1805396188 None] Create snapshot completed successfully
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Flow 'volume_create_manager' (f1b75ca0-8cbe-4eb2-b62e-873f7f0bd864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:41 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f0f936-519c-426f-95a2-96e50a959ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80f0f936-519c-426f-95a2-96e50a959ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=509fca0f-95af-4268-aa93-f9c1c256bf50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='667df3f10d0d45bc9842a0ba01a45174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8c5a7e41-2531-44b6-ae3d-3caca7f72df4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:42Z,use_quota=True,user_id='7a6156f51d234c1a9e2cde52e15f9067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4895926-d253-4202-88ca-b79392b6ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4895926-d253-4202-88ca-b79392b6ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9b881e-9b37-426b-a11a-7a6fc34e80fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9b881e-9b37-426b-a11a-7a6fc34e80fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '509fca0f-95af-4268-aa93-f9c1c256bf50', 'volume_name': 'volume-509fca0f-95af-4268-aa93-f9c1c256bf50', 'volume_size': 1, 'snapshot_id': '8c5a7e41-2531-44b6-ae3d-3caca7f72df4'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1ff389-34e2-4d1e-9428-ee490ef06bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1ff389-34e2-4d1e-9428-ee490ef06bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2150655-1eda-4a7b-94e7-19e02ec675f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:42 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Volume 509fca0f-95af-4268-aa93-f9c1c256bf50: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-509fca0f-95af-4268-aa93-f9c1c256bf50', 'volume_size': 1, 'snapshot_id': '8c5a7e41-2531-44b6-ae3d-3caca7f72df4'}
Jul 07 23:02:42 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 1073741824" returned: 0 in 1.040s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:42 devstack sudo[107175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4
Jul 07 23:02:42 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:42 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" returned: 0 in 0.640s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.190s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1703719832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21aa99d1-cdfe-43ca-a133-70451686d37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632d476354544d3dbf1325b0cf85b3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:40Z,use_quota=True,user_id='95e6ffa4be5e45ba990b459550956f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Creating volume 21aa99d1-cdfe-43ca-a133-70451686d37b {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:42 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (168f2ae2-284f-4235-b59d-f28e7250f3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:42 devstack sudo[107178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b 1073741824
Jul 07 23:02:42 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5adb539-db5e-4805-9dea-9e6b77ab952d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:42 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Volume volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 (f750c1ec-c154-45fb-a8fe-d9853a37c9c4): created successfully
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5adb539-db5e-4805-9dea-9e6b77ab952d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:42 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (8e65e34d-9895-435e-acb7-298837b92108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:42 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6733adc2-b216-4716-9d99-8e03fbdaae8e tempest-ProjectMemberTests-1327979039 None] Created volume successfully.
Jul 07 23:02:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:02:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:43 devstack sudo[107184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:02:43 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:43 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b 1073741824" returned: 0 in 0.905s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:43 devstack sudo[107186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b
Jul 07 23:02:43 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:44 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.634s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:02:44 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b" returned: 0 in 0.609s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.235s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "cinder-quobyte-8c5a7e41-2531-44b6-ae3d-3caca7f72df4-509fca0f-95af-4268-aa93-f9c1c256bf50" by "_create_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a5224b-0cf9-4e07-a8d9-6ee4d8c5c7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21aa99d1-cdfe-43ca-a133-70451686d37b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88400d33-45f1-403b-bf06-19f4e4397041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-8c5a7e41-2531-44b6-ae3d-3caca7f72df4-509fca0f-95af-4268-aa93-f9c1c256bf50" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Creating volume 509fca0f-95af-4268-aa93-f9c1c256bf50 from snapshot 8c5a7e41-2531-44b6-ae3d-3caca7f72df4 {{(pid=88077) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "cinder-quobyte-509fca0f-95af-4268-aa93-f9c1c256bf50" by "_copy_volume_from_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:44 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Volume volume-21aa99d1-cdfe-43ca-a133-70451686d37b (21aa99d1-cdfe-43ca-a133-70451686d37b): created successfully
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88400d33-45f1-403b-bf06-19f4e4397041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Flow 'volume_create_manager' (25ad16de-9848-40a3-8507-37b45ed5d356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-509fca0f-95af-4268-aa93-f9c1c256bf50" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] snapshot: 8c5a7e41-2531-44b6-ae3d-3caca7f72df4, volume: 509fca0f-95af-4268-aa93-f9c1c256bf50,  {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 23:02:44 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-af8a3c95-59e2-4e5b-abd7-3b4b00aa7290 tempest-ProjectReaderTests-1563190062 None] Created volume successfully.
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d550323-8911-42d8-a7c9-00a2e7bc240d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:44 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4
Jul 07 23:02:44 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Acquiring lock "cinder-21aa99d1-cdfe-43ca-a133-70451686d37b-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Lock "cinder-21aa99d1-cdfe-43ca-a133-70451686d37b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Acquiring lock "cinder-quobyte-21aa99d1-cdfe-43ca-a133-70451686d37b" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Lock "cinder-quobyte-21aa99d1-cdfe-43ca-a133-70451686d37b" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[04829bdc-82e5-4080-bd07-240593e22a15]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:44 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b
Jul 07 23:02:44 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:45 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4" returned: 0 in 0.792s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42e50674-422b-46c5-9962-b2d1b6e4859e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:02:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 23:02:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Creating direct copy from snapshot {{(pid=88077) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 23:02:45 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b8ac9a-1ce6-42c3-98d2-367f488689b3]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:45 devstack sudo[107197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e
Jul 07 23:02:45 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:45 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b" returned: 0 in 0.757s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:45 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b
Jul 07 23:02:45 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:46 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e" returned: 0 in 0.804s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG cinder.utils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Path /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50 not found in is_blk_device check {{(pid=88077) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:46 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50
Jul 07 23:02:46 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:46 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-21aa99d1-cdfe-43ca-a133-70451686d37b" returned: 0 in 0.667s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Lock "cinder-quobyte-21aa99d1-cdfe-43ca-a133-70451686d37b" released by "delete_volume" :: held 1.464s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=131,cinder:SELECT=76,cinder:INSERT=31,cinder:DELETE=11 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=113,cinder:SELECT=102,cinder:DELETE=10,cinder:INSERT=34 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Created reservations ['ab7e232a-b363-432b-8ec1-8675e088c1a8', 'f2f302f9-5d11-40e3-9110-c07d37a91490', 'f27789d5-57aa-42e6-83ca-1e32eb761c9e', '1ff9ebf4-cfbf-4082-a107-22a5dc971cd3'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:46 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:02:46 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Flow 'volume_create_manager' (0a1e5370-ed18-414a-80b3-6c8da7264158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18178ec-3275-443f-af2a-19ae09f30ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:48 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18178ec-3275-443f-af2a-19ae09f30ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380820129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c388da1c-5cc1-447d-94c5-333e33ece7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632d476354544d3dbf1325b0cf85b3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:48Z,use_quota=True,user_id='95e6ffa4be5e45ba990b459550956f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d085ef5a-e754-4eab-bf75-08554d167591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d085ef5a-e754-4eab-bf75-08554d167591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b78f4b4-29e5-4f5b-a8d1-f7ffca6f9403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b78f4b4-29e5-4f5b-a8d1-f7ffca6f9403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c388da1c-5cc1-447d-94c5-333e33ece7bc', 'volume_name': 'volume-c388da1c-5cc1-447d-94c5-333e33ece7bc', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33015f5-728d-4f4f-8e54-7a38fab9bea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33015f5-728d-4f4f-8e54-7a38fab9bea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44510cde-6de5-4843-ae05-5480422c0cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:48 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Volume c388da1c-5cc1-447d-94c5-333e33ece7bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c388da1c-5cc1-447d-94c5-333e33ece7bc', 'volume_size': 1}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 1.721s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:48 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Deleted volume successfully.
Jul 07 23:02:48 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-09608861-350f-43ee-9f58-093536d9741f tempest-ProjectReaderTests-1563190062 None] Lock "cinder-21aa99d1-cdfe-43ca-a133-70451686d37b-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:50 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50" returned: 0 in 4.796s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:50 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d787131-7dce-46f4-a7e0-31ce8acbfe87]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:50 devstack sudo[107230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e
Jul 07 23:02:50 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:51 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e" returned: 0 in 0.931s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:51 devstack cinder-volume[88077]: DEBUG cinder.image.image_utils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50 {{(pid=88077) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 23:02:51 devstack cinder-volume[88077]: INFO cinder.image.image_utils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Converted 1024.00 MB image at 213.50 MB/s
Jul 07 23:02:51 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50 is being set with open permissions: ugo+rw
Jul 07 23:02:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:51 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50
Jul 07 23:02:51 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:52 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50" returned: 0 in 0.700s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-509fca0f-95af-4268-aa93-f9c1c256bf50" released by "_copy_volume_from_snapshot" :: held 8.121s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-8c5a7e41-2531-44b6-ae3d-3caca7f72df4-509fca0f-95af-4268-aa93-f9c1c256bf50" released by "_create_volume_from_snapshot" :: held 8.172s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.204s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.930s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Creating offline snapshot 8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b of volume f750c1ec-c154-45fb-a8fe-d9853a37c9c4 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6bbdf0-33ed-4924-8637-2e262e7cd65b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2150655-1eda-4a7b-94e7-19e02ec675f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-509fca0f-95af-4268-aa93-f9c1c256bf50', 'volume_size': 1, 'snapshot_id': '8c5a7e41-2531-44b6-ae3d-3caca7f72df4'}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30ee497-9d09-4ea2-8d8e-62d5627aab99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:52 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Volume volume-509fca0f-95af-4268-aa93-f9c1c256bf50 (509fca0f-95af-4268-aa93-f9c1c256bf50): created successfully
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a30ee497-9d09-4ea2-8d8e-62d5627aab99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Flow 'volume_create_manager' (f1b75ca0-8cbe-4eb2-b62e-873f7f0bd864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:52 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ed02b5d4-d1c0-45cd-a809-2ecfc33ad175 tempest-SnapshotDependencyTests-1805396188 None] Created volume successfully.
Jul 07 23:02:52 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4
Jul 07 23:02:52 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "cinder-8c5a7e41-2531-44b6-ae3d-3caca7f72df4-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-8c5a7e41-2531-44b6-ae3d-3caca7f72df4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "cinder-quobyte-42e50674-422b-46c5-9962-b2d1b6e4859e" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-42e50674-422b-46c5-9962-b2d1b6e4859e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "cinder-quobyte-8c5a7e41-2531-44b6-ae3d-3caca7f72df4" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-8c5a7e41-2531-44b6-ae3d-3caca7f72df4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Deleting offline snapshot 8c5a7e41-2531-44b6-ae3d-3caca7f72df4 of volume 42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] snapshot_file for this snap is: volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed979799-a85f-4865-9c63-ab9d773a12d7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:52 devstack sudo[107241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4
Jul 07 23:02:52 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:53 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" returned: 0 in 0.813s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:53 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b 1G
Jul 07 23:02:53 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:53 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4" returned: 0 in 0.789s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42e50674-422b-46c5-9962-b2d1b6e4859e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:02:53 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaf4e42-19bc-484c-b03e-907be377f0c3]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:53 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e
Jul 07 23:02:53 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:54 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b 1G" returned: 0 in 0.803s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:54 devstack sudo[107256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b
Jul 07 23:02:54 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:54 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e" returned: 0 in 0.784s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:54 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4
Jul 07 23:02:54 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:54 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b" returned: 0 in 0.687s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:54 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b is being set with open permissions: ugo+rw
Jul 07 23:02:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:54 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b
Jul 07 23:02:54 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:55 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4" returned: 0 in 0.770s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:55 devstack sudo[107272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4
Jul 07 23:02:55 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:55 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b" returned: 0 in 0.707s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:55 devstack sudo[107275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.info
Jul 07 23:02:55 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:55 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e.8c5a7e41-2531-44b6-ae3d-3caca7f72df4" returned: 0 in 0.655s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-8c5a7e41-2531-44b6-ae3d-3caca7f72df4" released by "_delete_snapshot" :: held 3.121s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-42e50674-422b-46c5-9962-b2d1b6e4859e" released by "delete_snapshot" :: held 3.146s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Created reservations ['c5b3ab91-163d-447f-9c82-a7c4b5c0bde6', 'a874200d-fb9f-4dd0-81ef-c81358e30876', '90863a40-80be-4b32-9d04-31c394c1a073', 'c2907969-e3c3-4556-a840-1acb955a0d24'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Delete snapshot completed successfully.
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6b97ae96-d17e-499e-89b5-c3073a10934b tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-8c5a7e41-2531-44b6-ae3d-3caca7f72df4-delete_snapshot" released by "delete_snapshot" :: held 3.314s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:56 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.info" returned: 0 in 0.664s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:56 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.info is being set with open permissions: ugo+rw
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:56 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.info
Jul 07 23:02:56 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:56 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.info" returned: 0 in 0.648s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.415s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.739s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380820129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c388da1c-5cc1-447d-94c5-333e33ece7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632d476354544d3dbf1325b0cf85b3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:48Z,use_quota=True,user_id='95e6ffa4be5e45ba990b459550956f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Creating volume c388da1c-5cc1-447d-94c5-333e33ece7bc {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:56 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:02:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:56 devstack sudo[107282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc 1073741824
Jul 07 23:02:56 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c80547c2-82ba-4238-98a4-d740b64330be tempest-ProjectMemberTests-1327979039 None] Create snapshot completed successfully
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "cinder-42e50674-422b-46c5-9962-b2d1b6e4859e-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-42e50674-422b-46c5-9962-b2d1b6e4859e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "cinder-quobyte-42e50674-422b-46c5-9962-b2d1b6e4859e" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-42e50674-422b-46c5-9962-b2d1b6e4859e" acquired by "delete_volume" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a87147b-a36d-4ee0-bdd4-2aa2290e4569]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Lock "cinder-8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Deleting offline snapshot 8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b of volume f750c1ec-c154-45fb-a8fe-d9853a37c9c4 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] snapshot_file for this snap is: volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a567d07-12de-41f8-a2b4-3632fa8edadc]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:57 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e
Jul 07 23:02:57 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:57 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b
Jul 07 23:02:57 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:57 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc 1073741824" returned: 0 in 0.895s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:57 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc
Jul 07 23:02:57 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:58 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e" returned: 0 in 0.832s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:58 devstack sudo[107298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e
Jul 07 23:02:58 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:58 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b" returned: 0 in 0.838s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9ba856-4f7f-4726-ac91-2c64b0f452dc]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:58 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4
Jul 07 23:02:58 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:58 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc" returned: 0 in 0.664s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44510cde-6de5-4843-ae05-5480422c0cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c388da1c-5cc1-447d-94c5-333e33ece7bc', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18878cbb-e3b2-49bb-85b5-ae651d2e29db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:58 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Volume volume-c388da1c-5cc1-447d-94c5-333e33ece7bc (c388da1c-5cc1-447d-94c5-333e33ece7bc): created successfully
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18878cbb-e3b2-49bb-85b5-ae651d2e29db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Flow 'volume_create_manager' (0a1e5370-ed18-414a-80b3-6c8da7264158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:58 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-e4a6a559-6202-439f-b741-82890d0e62ed tempest-ProjectReaderTests-1563190062 None] Created volume successfully.
Jul 07 23:02:58 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-42e50674-422b-46c5-9962-b2d1b6e4859e" returned: 0 in 0.706s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-42e50674-422b-46c5-9962-b2d1b6e4859e" released by "delete_volume" :: held 1.623s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Created reservations ['10c99d68-1971-45e5-ba71-3272f79ef174', '6835adfc-c13d-4d50-a890-d237ea6cb159', '913301c5-719d-4898-b282-1f33187d7c63', 'd2d77a3e-f990-4191-8648-e381ffdf91de'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:58 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:02:58 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:59 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" returned: 0 in 0.825s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:59 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b
Jul 07 23:02:59 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "cinder-509fca0f-95af-4268-aa93-f9c1c256bf50-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-509fca0f-95af-4268-aa93-f9c1c256bf50-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "cinder-quobyte-509fca0f-95af-4268-aa93-f9c1c256bf50" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-509fca0f-95af-4268-aa93-f9c1c256bf50" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d35010-3d9e-4c30-a241-1cae6187d43b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:59 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50
Jul 07 23:02:59 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:59 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.739s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:59 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Deleted volume successfully.
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-84e9a12c-8799-4f31-b731-9a76db9b62a3 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-42e50674-422b-46c5-9962-b2d1b6e4859e-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "cinder-c388da1c-5cc1-447d-94c5-333e33ece7bc-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-c388da1c-5cc1-447d-94c5-333e33ece7bc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "cinder-quobyte-c388da1c-5cc1-447d-94c5-333e33ece7bc" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-quobyte-c388da1c-5cc1-447d-94c5-333e33ece7bc" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ea6820-5a3d-478b-bfaa-630c86a69b1e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:59 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b" returned: 0 in 0.870s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:59 devstack sudo[107321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b
Jul 07 23:02:59 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:59 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc
Jul 07 23:02:59 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:00 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50" returned: 0 in 0.874s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:00 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50
Jul 07 23:03:00 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:00 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4.8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b" returned: 0 in 0.693s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:00 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b" released by "_delete_snapshot" :: held 3.344s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc" returned: 0 in 0.798s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" released by "delete_snapshot" :: held 3.384s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:00 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc
Jul 07 23:03:00 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:00 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Created reservations ['5f7c0c6b-dd20-4d20-b5a8-fcb68d4ccf36', '21713229-7de1-4634-80c6-8bc5e6f41660', 'cc9dda91-2a7d-429e-a1b8-2f1e2da6d4f0', '4003692d-e879-46ae-86d7-68422db3f980'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Delete snapshot completed successfully.
Jul 07 23:03:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-6f5ed79f-d7f6-44cf-b610-070480442b5a tempest-ProjectMemberTests-1327979039 None] Lock "cinder-8bc3c3d4-2cc8-4fe8-be85-79a0e3fdc64b-delete_snapshot" released by "delete_snapshot" :: held 3.538s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:01 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-509fca0f-95af-4268-aa93-f9c1c256bf50" returned: 0 in 0.693s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-quobyte-509fca0f-95af-4268-aa93-f9c1c256bf50" released by "delete_volume" :: held 1.617s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Created reservations ['de02c057-61a7-4481-b073-2304469a0f5d', '4d08027d-fa21-4e6f-8807-f1f0e9a0097d', '0e628137-54fa-4f0f-8c8f-71706cd56a27', '3eb51740-5a07-402b-8ace-225a22934982'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:01 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:03:01 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:01 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-c388da1c-5cc1-447d-94c5-333e33ece7bc" returned: 0 in 0.637s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-quobyte-c388da1c-5cc1-447d-94c5-333e33ece7bc" released by "delete_volume" :: held 1.477s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Created reservations ['7382c191-734e-4b1b-bd04-2be578e25ff5', '4911f2cf-52a7-4c66-809f-71cef7a57847', '744dbd24-6f94-4900-b495-7ba4a1038928', '533c600d-60f0-481d-a82a-22d33b1364bd'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:01 devstack sudo[107340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:03:01 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-f750c1ec-c154-45fb-a8fe-d9853a37c9c4-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Lock "cinder-f750c1ec-c154-45fb-a8fe-d9853a37c9c4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2388fa-559b-45b4-add8-40e1ba119706]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:01 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4
Jul 07 23:03:01 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:02 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.843s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Deleted volume successfully.
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7c5af1bc-5451-4dc1-b176-cd22643636a4 tempest-SnapshotDependencyTests-1805396188 None] Lock "cinder-509fca0f-95af-4268-aa93-f9c1c256bf50-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:02 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.762s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:02 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Deleted volume successfully.
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d778f6a8-c81a-4e37-bfa4-716a5ce4a157 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-c388da1c-5cc1-447d-94c5-333e33ece7bc-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Flow 'volume_create_manager' (f0d87e42-9dc5-4efc-9b27-9dcfb84b42a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4069ed0b-ad0e-4eab-ab2d-e39a495e8a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4069ed0b-ad0e-4eab-ab2d-e39a495e8a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387874863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632d476354544d3dbf1325b0cf85b3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:03Z,use_quota=True,user_id='95e6ffa4be5e45ba990b459550956f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d863343-9b46-432b-8411-a602c7c02d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d863343-9b46-432b-8411-a602c7c02d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9655f486-9bf5-48b8-a4d9-421fa39dddb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9655f486-9bf5-48b8-a4d9-421fa39dddb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0', 'volume_name': 'volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc44b77d-7569-4df5-9d62-00b6a48c566b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc44b77d-7569-4df5-9d62-00b6a48c566b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860518d6-0c9f-4eb4-88e9-603bbe30ad82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:02 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Volume 698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0', 'volume_size': 1}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-387874863',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632d476354544d3dbf1325b0cf85b3ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:03Z,use_quota=True,user_id='95e6ffa4be5e45ba990b459550956f48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Creating volume 698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:03:02 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:02 devstack sudo[107349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0 1073741824
Jul 07 23:03:02 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:02 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" returned: 0 in 1.097s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:02 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4
Jul 07 23:03:02 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:03 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" returned: 0 in 0.685s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-f750c1ec-c154-45fb-a8fe-d9853a37c9c4" released by "delete_volume" :: held 1.848s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Created reservations ['07b020c2-2c08-45f6-83a0-30c79913bcab', '38f59e87-6d39-41ed-877c-6cf5d3bc672b', 'ec62d7a7-884f-4ee4-8652-15658a6c15dc', '2423717f-78ef-4f9d-84ef-e99e3497d23f'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:03 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0 1073741824" returned: 0 in 0.944s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:03 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:03:03 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:03 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0
Jul 07 23:03:03 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:04 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.780s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Deleted volume successfully.
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bc9687b3-c315-4355-a1f5-cf32dd90569a tempest-ProjectMemberTests-1327979039 None] Lock "cinder-f750c1ec-c154-45fb-a8fe-d9853a37c9c4-delete_volume" released by "delete_volume" :: held 2.931s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:03:04 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (9aecf5e7-d7b6-4b98-8871-f37372422577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006f0935-cac6-4240-8d7c-23885f2ab080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0" returned: 0 in 0.883s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006f0935-cac6-4240-8d7c-23885f2ab080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-608741639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1436b951-bce6-4b56-a714-6bd41dd39e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:05Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7210809-aa25-4353-82bd-8f6fba86625c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7210809-aa25-4353-82bd-8f6fba86625c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0faa97-1b00-44d1-ae1e-5e64e70c523e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0faa97-1b00-44d1-ae1e-5e64e70c523e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1436b951-bce6-4b56-a714-6bd41dd39e05', 'volume_name': 'volume-1436b951-bce6-4b56-a714-6bd41dd39e05', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b514a3a0-7932-47c8-af55-2523022cd4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b514a3a0-7932-47c8-af55-2523022cd4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c62a82-4b31-4f46-9d79-b422d049ba9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:04 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Volume 1436b951-bce6-4b56-a714-6bd41dd39e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1436b951-bce6-4b56-a714-6bd41dd39e05', 'volume_size': 1}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-608741639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1436b951-bce6-4b56-a714-6bd41dd39e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:05Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Creating volume 1436b951-bce6-4b56-a714-6bd41dd39e05 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:03:04 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (860518d6-0c9f-4eb4-88e9-603bbe30ad82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bcc4b14-cbae-4dfd-a931-6702c0050d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:04 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05 1073741824
Jul 07 23:03:04 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:04 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Volume volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0 (698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0): created successfully
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bcc4b14-cbae-4dfd-a931-6702c0050d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:04 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Flow 'volume_create_manager' (f0d87e42-9dc5-4efc-9b27-9dcfb84b42a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-66d1883d-6e10-476b-8515-27b96ce462fa tempest-ProjectReaderTests-1563190062 None] Created volume successfully.
Jul 07 23:03:05 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05 1073741824" returned: 0 in 0.928s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:05 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05
Jul 07 23:03:05 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "cinder-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "cinder-quobyte-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:05 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-quobyte-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:05 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[df03d7a0-9a82-483a-92df-6d64b01fdee7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:06 devstack sudo[107374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0
Jul 07 23:03:06 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:06 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05" returned: 0 in 0.718s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34c62a82-4b31-4f46-9d79-b422d049ba9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1436b951-bce6-4b56-a714-6bd41dd39e05', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900d2903-825d-4a46-b57e-a45625f93fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:06 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Volume volume-1436b951-bce6-4b56-a714-6bd41dd39e05 (1436b951-bce6-4b56-a714-6bd41dd39e05): created successfully
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900d2903-825d-4a46-b57e-a45625f93fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (9aecf5e7-d7b6-4b98-8871-f37372422577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:06 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-2dec3359-4376-4ef2-9604-c0ac0d55f997 tempest-ProjectMemberTests-1327979039 None] Created volume successfully.
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Creating offline snapshot 1939edb4-a818-47d7-98dc-c8a90f96a00d of volume 1436b951-bce6-4b56-a714-6bd41dd39e05 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3423ff11-0ae3-4f39-a25a-e39d0196836f]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:06 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0" returned: 0 in 0.899s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:06 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0
Jul 07 23:03:06 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:06 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05
Jul 07 23:03:06 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:07 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0" returned: 0 in 0.738s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-quobyte-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0" released by "delete_volume" :: held 1.687s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Created reservations ['840acd25-9acc-4269-9287-d22e1c50e950', 'da242982-7611-4444-b69a-33deeb648c4d', '42714c3b-4d78-415e-979f-87fa33c12eaa', '7c2b68f6-0d26-4541-8969-c177377e0591'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:07 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05" returned: 0 in 0.899s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:07 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d 1G
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:07 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:07 devstack sudo[107392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:03:07 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:08 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.836s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:08 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:08 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Deleted volume successfully.
Jul 07 23:03:08 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b6a8e6a3-6b84-4bdf-857b-614254e27d43 tempest-ProjectReaderTests-1563190062 None] Lock "cinder-698c1024-ca91-4ca1-a4e3-0ea67fd2a2f0-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:08 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d 1G" returned: 0 in 1.058s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1436b951-bce6-4b56-a714-6bd41dd39e05 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:08 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1436b951-bce6-4b56-a714-6bd41dd39e05 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d
Jul 07 23:03:08 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:09 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1436b951-bce6-4b56-a714-6bd41dd39e05 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d" returned: 0 in 0.833s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:09 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d is being set with open permissions: ugo+rw
Jul 07 23:03:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:09 devstack sudo[107405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d
Jul 07 23:03:09 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:10 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d" returned: 0 in 0.753s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:10 devstack sudo[107409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.info
Jul 07 23:03:10 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:11 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.info" returned: 0 in 0.653s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:11 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.info is being set with open permissions: ugo+rw
Jul 07 23:03:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:11 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.info
Jul 07 23:03:11 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:11 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.info" returned: 0 in 0.684s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.986s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-17855b7b-96ef-4312-a2b7-1b4e516bc1c3 tempest-ProjectMemberTests-1327979039 None] Create snapshot completed successfully
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-1939edb4-a818-47d7-98dc-c8a90f96a00d-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-1939edb4-a818-47d7-98dc-c8a90f96a00d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-1436b951-bce6-4b56-a714-6bd41dd39e05" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-1436b951-bce6-4b56-a714-6bd41dd39e05" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-1939edb4-a818-47d7-98dc-c8a90f96a00d" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-1939edb4-a818-47d7-98dc-c8a90f96a00d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Deleting offline snapshot 1939edb4-a818-47d7-98dc-c8a90f96a00d of volume 1436b951-bce6-4b56-a714-6bd41dd39e05 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] snapshot_file for this snap is: volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[807a5f24-2245-4446-95a4-1e3bbe2e271c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:12 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d
Jul 07 23:03:12 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:12 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d" returned: 0 in 0.729s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1436b951-bce6-4b56-a714-6bd41dd39e05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f52c00-0371-45d5-a23f-c4d20f77c15e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:12 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05
Jul 07 23:03:12 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:13 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05" returned: 0 in 0.717s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:13 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d
Jul 07 23:03:13 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:14 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d" returned: 0 in 0.699s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:14 devstack sudo[107433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d
Jul 07 23:03:14 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:14 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05.1939edb4-a818-47d7-98dc-c8a90f96a00d" returned: 0 in 0.657s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-1939edb4-a818-47d7-98dc-c8a90f96a00d" released by "_delete_snapshot" :: held 2.917s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-1436b951-bce6-4b56-a714-6bd41dd39e05" released by "delete_snapshot" :: held 2.943s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:15 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Created reservations ['a96f9b45-9ed3-46f6-aa44-ba3ca29dcd66', 'b1593c7c-837d-4b1a-a073-d0ba0d6b0386', 'bce0a6dd-956e-4e40-80b9-c21028717e23', 'f9e3437c-e822-4dea-a51f-94a274ed0835'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:15 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Delete snapshot completed successfully.
Jul 07 23:03:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-da3ff09d-ae07-4c24-82a0-c1270453ec05 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-1939edb4-a818-47d7-98dc-c8a90f96a00d-delete_snapshot" released by "delete_snapshot" :: held 3.106s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-1436b951-bce6-4b56-a714-6bd41dd39e05-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Lock "cinder-1436b951-bce6-4b56-a714-6bd41dd39e05-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-1436b951-bce6-4b56-a714-6bd41dd39e05" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-1436b951-bce6-4b56-a714-6bd41dd39e05" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:15 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff985b06-23d3-43e3-9df9-dd3e351daf2b]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:15 devstack sudo[107436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05
Jul 07 23:03:15 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:16 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05" returned: 0 in 0.797s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:16 devstack sudo[107443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05
Jul 07 23:03:16 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:16 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-1436b951-bce6-4b56-a714-6bd41dd39e05" returned: 0 in 0.661s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-1436b951-bce6-4b56-a714-6bd41dd39e05" released by "delete_volume" :: held 1.517s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Created reservations ['8178891d-ea13-48ad-84ce-ab24cabc49d4', 'dd3262e3-a3e4-4897-a55d-f14b10c85536', '6c183e4c-40bb-47a0-8347-31a83f387207', 'a06cbf80-8714-484e-96eb-653f42219e3d'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:17 devstack sudo[107447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:03:17 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:17 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.695s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:17 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:17 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Deleted volume successfully.
Jul 07 23:03:17 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-d01086d1-0e0f-49a9-990b-7906bda59b7f tempest-ProjectMemberTests-1327979039 None] Lock "cinder-1436b951-bce6-4b56-a714-6bd41dd39e05-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:17 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (04c00fd1-acf5-41f7-bb84-91b5b8ad872d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abc4fc0-7249-4cc3-b01f-c5f6ab424371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abc4fc0-7249-4cc3-b01f-c5f6ab424371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000856852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e46913b-6569-4e51-bbe8-590c134ff803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:18Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130a34dc-d945-47ec-a973-e9672d1d0666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (130a34dc-d945-47ec-a973-e9672d1d0666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b45e4c-a02d-45cc-b39e-a70719e60670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20b45e4c-a02d-45cc-b39e-a70719e60670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e46913b-6569-4e51-bbe8-590c134ff803', 'volume_name': 'volume-5e46913b-6569-4e51-bbe8-590c134ff803', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1b1d0c-5abc-409e-9fe4-33be430ef39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1b1d0c-5abc-409e-9fe4-33be430ef39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85a4f63-e392-4bae-b3c6-9d376b6cfc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:18 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Volume 5e46913b-6569-4e51-bbe8-590c134ff803: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e46913b-6569-4e51-bbe8-590c134ff803', 'volume_size': 1}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1000856852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e46913b-6569-4e51-bbe8-590c134ff803,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:18Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Creating volume 5e46913b-6569-4e51-bbe8-590c134ff803 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:03:18 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:18 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803 1073741824
Jul 07 23:03:18 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:18 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803 1073741824" returned: 0 in 0.791s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:18 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803
Jul 07 23:03:18 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:19 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803" returned: 0 in 0.668s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:03:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e85a4f63-e392-4bae-b3c6-9d376b6cfc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e46913b-6569-4e51-bbe8-590c134ff803', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de65d5d-aafd-4735-ab10-6dd60280ef72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:19 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Volume volume-5e46913b-6569-4e51-bbe8-590c134ff803 (5e46913b-6569-4e51-bbe8-590c134ff803): created successfully
Jul 07 23:03:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de65d5d-aafd-4735-ab10-6dd60280ef72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:19 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (04c00fd1-acf5-41f7-bb84-91b5b8ad872d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:19 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-eb050692-45d6-42e4-a2e4-8fd80ea405fc tempest-ProjectMemberTests-1327979039 None] Created volume successfully.
Jul 07 23:03:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:20 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Creating offline snapshot 857300e3-0af8-4ead-ab26-0324458fef08 of volume 5e46913b-6569-4e51-bbe8-590c134ff803 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:03:20 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5b7ad2-8947-4e2a-912b-d7c075013309]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:20 devstack sudo[107458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803
Jul 07 23:03:20 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:21 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803" returned: 0 in 0.793s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:21 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08 1G
Jul 07 23:03:21 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:21 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08 1G" returned: 0 in 0.799s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e46913b-6569-4e51-bbe8-590c134ff803 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:21 devstack sudo[107470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e46913b-6569-4e51-bbe8-590c134ff803 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08
Jul 07 23:03:21 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:22 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e46913b-6569-4e51-bbe8-590c134ff803 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08" returned: 0 in 0.704s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:22 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08 is being set with open permissions: ugo+rw
Jul 07 23:03:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:22 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08
Jul 07 23:03:22 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:23 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08" returned: 0 in 0.645s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:23 devstack sudo[107478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.info
Jul 07 23:03:23 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:23 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.info" returned: 0 in 0.637s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:23 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.info is being set with open permissions: ugo+rw
Jul 07 23:03:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:23 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.info
Jul 07 23:03:23 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:24 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.info" returned: 0 in 0.660s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.320s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:24 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-12cb8ebc-ce37-476c-a1e7-8e7cca6bc9aa tempest-ProjectMemberTests-1327979039 None] Create snapshot completed successfully
Jul 07 23:03:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-857300e3-0af8-4ead-ab26-0324458fef08-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-857300e3-0af8-4ead-ab26-0324458fef08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-5e46913b-6569-4e51-bbe8-590c134ff803" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-5e46913b-6569-4e51-bbe8-590c134ff803" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-857300e3-0af8-4ead-ab26-0324458fef08" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-857300e3-0af8-4ead-ab26-0324458fef08" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Deleting offline snapshot 857300e3-0af8-4ead-ab26-0324458fef08 of volume 5e46913b-6569-4e51-bbe8-590c134ff803 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:03:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] snapshot_file for this snap is: volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:03:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdb5b43-f5c5-4871-b6bf-bfce9150cf43]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:25 devstack sudo[107520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08
Jul 07 23:03:25 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:26 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08" returned: 0 in 0.759s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:26 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e46913b-6569-4e51-bbe8-590c134ff803(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:03:26 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a0a317-b6a7-4e07-8018-5fa3e1ded0a8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:26 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803
Jul 07 23:03:26 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:27 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803" returned: 0 in 0.741s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:27 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08
Jul 07 23:03:27 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:27 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08" returned: 0 in 0.747s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:27 devstack sudo[107536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08
Jul 07 23:03:27 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:28 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803.857300e3-0af8-4ead-ab26-0324458fef08" returned: 0 in 0.630s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-857300e3-0af8-4ead-ab26-0324458fef08" released by "_delete_snapshot" :: held 2.968s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-5e46913b-6569-4e51-bbe8-590c134ff803" released by "delete_snapshot" :: held 2.996s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Created reservations ['1c149439-0d5b-4aa4-a09d-9e9f7a5a94d3', 'd4ed4e95-2136-4131-9c89-12ae7ee36824', '4bf08e5a-b5c5-44b6-a70d-97c5db33b42d', '8b52fbbc-2622-45c5-a754-77a7107488de'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:28 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Delete snapshot completed successfully.
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3315a02e-7f63-419d-a47a-19f923eabf3b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-857300e3-0af8-4ead-ab26-0324458fef08-delete_snapshot" released by "delete_snapshot" :: held 3.140s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-5e46913b-6569-4e51-bbe8-590c134ff803-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-5e46913b-6569-4e51-bbe8-590c134ff803-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-5e46913b-6569-4e51-bbe8-590c134ff803" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-5e46913b-6569-4e51-bbe8-590c134ff803" acquired by "delete_volume" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a5ca37-c8f0-4fd0-ac80-96d246d8a776]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:28 devstack sudo[107539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803
Jul 07 23:03:28 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:29 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803" returned: 0 in 0.745s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:29 devstack sudo[107544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803
Jul 07 23:03:29 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:30 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-5e46913b-6569-4e51-bbe8-590c134ff803" returned: 0 in 0.634s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-5e46913b-6569-4e51-bbe8-590c134ff803" released by "delete_volume" :: held 1.435s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Created reservations ['07d3a8a7-4d18-434b-a23e-7bc8af39214c', 'dc822e2a-091c-43d8-95b1-f75bf37431e7', '94dd0703-ca25-44fa-8e85-36fbe76adec8', 'f50766a4-b8f7-4d9c-b88d-6039c5884114'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:30 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:03:30 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:30 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.630s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:30 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Deleted volume successfully.
Jul 07 23:03:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-9245e9f4-6fbf-456b-9c1c-e47afdda3ac2 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-5e46913b-6569-4e51-bbe8-590c134ff803-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (d0ad7a65-532b-4ffa-94ed-24587c32a48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6be2095-d72a-43cd-bd29-b00f381e9343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6be2095-d72a-43cd-bd29-b00f381e9343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961720495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ac4acf-703d-4542-b8c9-4c1d0085576c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:31Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac40a2b-5684-4792-819c-8e8384a51aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac40a2b-5684-4792-819c-8e8384a51aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c1bc80-1a3a-4214-8e4b-638e9d96342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47c1bc80-1a3a-4214-8e4b-638e9d96342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3ac4acf-703d-4542-b8c9-4c1d0085576c', 'volume_name': 'volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86998f08-8269-41be-8d0e-d22dcc1ab18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86998f08-8269-41be-8d0e-d22dcc1ab18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e1ebcc-a819-460a-ad68-e24a4901950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:31 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Volume f3ac4acf-703d-4542-b8c9-4c1d0085576c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c', 'volume_size': 1}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961720495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3ac4acf-703d-4542-b8c9-4c1d0085576c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:31Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Creating volume f3ac4acf-703d-4542-b8c9-4c1d0085576c {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:03:31 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:03:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:31 devstack sudo[107551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c 1073741824
Jul 07 23:03:31 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:32 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c 1073741824" returned: 0 in 0.924s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:32 devstack sudo[107557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c
Jul 07 23:03:32 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:33 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c" returned: 0 in 0.676s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e1ebcc-a819-460a-ad68-e24a4901950c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3073f8c-b705-490e-a6ba-6202eac3eb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Volume volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c (f3ac4acf-703d-4542-b8c9-4c1d0085576c): created successfully
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3073f8c-b705-490e-a6ba-6202eac3eb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (d0ad7a65-532b-4ffa-94ed-24587c32a48c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-48ff421c-e339-4008-a9ea-df62df909b71 tempest-ProjectMemberTests-1327979039 None] Created volume successfully.
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Creating offline snapshot 8c9e242c-6c48-43b2-b293-0d38ec5952cc of volume f3ac4acf-703d-4542-b8c9-4c1d0085576c {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d24184b-4888-4562-9b24-16c161cd5c62]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:33 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c
Jul 07 23:03:33 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:34 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c" returned: 0 in 0.752s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:34 devstack sudo[107565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc 1G
Jul 07 23:03:34 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:35 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc 1G" returned: 0 in 0.739s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:35 devstack sudo[107571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc
Jul 07 23:03:35 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:35 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc" returned: 0 in 0.677s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:35 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc is being set with open permissions: ugo+rw
Jul 07 23:03:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:35 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc
Jul 07 23:03:35 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:36 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc" returned: 0 in 0.622s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:36 devstack sudo[107580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.info
Jul 07 23:03:36 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:37 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.info" returned: 0 in 0.617s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:37 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.info is being set with open permissions: ugo+rw
Jul 07 23:03:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:37 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.info
Jul 07 23:03:37 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:37 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.info" returned: 0 in 0.653s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.138s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-04c07537-1d51-4c25-87dc-b2b0a4c5de39 tempest-ProjectMemberTests-1327979039 None] Create snapshot completed successfully
Jul 07 23:03:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-8c9e242c-6c48-43b2-b293-0d38ec5952cc-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-8c9e242c-6c48-43b2-b293-0d38ec5952cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-f3ac4acf-703d-4542-b8c9-4c1d0085576c" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-f3ac4acf-703d-4542-b8c9-4c1d0085576c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-8c9e242c-6c48-43b2-b293-0d38ec5952cc" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-8c9e242c-6c48-43b2-b293-0d38ec5952cc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Deleting offline snapshot 8c9e242c-6c48-43b2-b293-0d38ec5952cc of volume f3ac4acf-703d-4542-b8c9-4c1d0085576c {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:03:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] snapshot_file for this snap is: volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:03:38 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[df60964f-f095-4b8e-93a7-e8153e1315bd]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:39 devstack sudo[107586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc
Jul 07 23:03:39 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:39 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc" returned: 0 in 0.769s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:03:39 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb382f0-bbed-4a3b-86ad-9d59cba71440]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:39 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c
Jul 07 23:03:39 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:40 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c" returned: 0 in 0.753s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:40 devstack sudo[107596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc
Jul 07 23:03:40 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:41 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc" returned: 0 in 0.734s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:41 devstack sudo[107602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc
Jul 07 23:03:41 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:41 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c.8c9e242c-6c48-43b2-b293-0d38ec5952cc" returned: 0 in 0.640s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-8c9e242c-6c48-43b2-b293-0d38ec5952cc" released by "_delete_snapshot" :: held 2.991s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-f3ac4acf-703d-4542-b8c9-4c1d0085576c" released by "delete_snapshot" :: held 3.015s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:41 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Created reservations ['48a080e3-e642-4a43-9188-7138b8ac4fc7', 'ec1cc046-d3d9-464e-8037-cb175ac1dcce', '0ef3653b-d0a3-40b2-84b2-773266a31ee9', 'a424ee43-99d2-4e5c-965a-99adfe254f55'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:42 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Delete snapshot completed successfully.
Jul 07 23:03:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-971d5536-3fc4-4284-94bb-e57961b5033b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-8c9e242c-6c48-43b2-b293-0d38ec5952cc-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-f3ac4acf-703d-4542-b8c9-4c1d0085576c-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-f3ac4acf-703d-4542-b8c9-4c1d0085576c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-f3ac4acf-703d-4542-b8c9-4c1d0085576c" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-f3ac4acf-703d-4542-b8c9-4c1d0085576c" acquired by "delete_volume" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8744a484-5aff-4b66-8d13-066e187e5a62]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:43 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c
Jul 07 23:03:43 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:43 devstack sudo[107607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:03:43 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:43 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c" returned: 0 in 0.764s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:44 devstack sudo[107612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c
Jul 07 23:03:44 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:44 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.716s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:03:44 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f3ac4acf-703d-4542-b8c9-4c1d0085576c" returned: 0 in 0.697s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-f3ac4acf-703d-4542-b8c9-4c1d0085576c" released by "delete_volume" :: held 1.516s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Created reservations ['8e2842cd-ad88-4c39-8d25-94681d71c9ba', '6a4e9ae6-33ee-460f-adec-f41cbaa7ae7c', '3daddd08-d993-4435-8c73-9c50c3d3db15', '5cca4488-be9c-4eb9-aa24-e2cdd96d3a2a'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:44 devstack sudo[107616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:03:44 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:45 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.653s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:45 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Deleted volume successfully.
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ada8860a-1b1f-440f-bfc4-d22736f060e5 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-f3ac4acf-703d-4542-b8c9-4c1d0085576c-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (53d40824-53cd-4f9b-b08e-b23d5456203b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e987b4-0394-4427-9b6f-53fb1aa17fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e987b4-0394-4427-9b6f-53fb1aa17fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-898923159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfba7565-af61-4833-9d09-f306eb353d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:46Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d477b6f-5c4d-4a4f-b7a2-8d43d3a74561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d477b6f-5c4d-4a4f-b7a2-8d43d3a74561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b63124-5550-4b32-87a1-40a9c0b44e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b63124-5550-4b32-87a1-40a9c0b44e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfba7565-af61-4833-9d09-f306eb353d0b', 'volume_name': 'volume-cfba7565-af61-4833-9d09-f306eb353d0b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0342bc7-5ec9-4687-8f45-4b660714c25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0342bc7-5ec9-4687-8f45-4b660714c25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88cdce7f-2f33-43b4-9625-2474c653d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:45 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Volume cfba7565-af61-4833-9d09-f306eb353d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfba7565-af61-4833-9d09-f306eb353d0b', 'volume_size': 1}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-898923159',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfba7565-af61-4833-9d09-f306eb353d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:46Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Creating volume cfba7565-af61-4833-9d09-f306eb353d0b {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:03:45 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:03:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:45 devstack sudo[107625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b 1073741824
Jul 07 23:03:45 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:46 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b 1073741824" returned: 0 in 0.864s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:46 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:INSERT=28,cinder:UPDATE=122,cinder:SELECT=90,cinder:DELETE=10 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:03:46 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=93,cinder:INSERT=37,cinder:UPDATE=123,cinder:DELETE=9 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:03:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:46 devstack sudo[107630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b
Jul 07 23:03:46 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:47 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b" returned: 0 in 0.633s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:03:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88cdce7f-2f33-43b4-9625-2474c653d072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfba7565-af61-4833-9d09-f306eb353d0b', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a59a291-b986-4b32-b752-6f3edf4156a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:47 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Volume volume-cfba7565-af61-4833-9d09-f306eb353d0b (cfba7565-af61-4833-9d09-f306eb353d0b): created successfully
Jul 07 23:03:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a59a291-b986-4b32-b752-6f3edf4156a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (53d40824-53cd-4f9b-b08e-b23d5456203b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5afaf8d1-9dbb-43cd-8887-778e7733cee3 tempest-ProjectMemberTests-1327979039 None] Created volume successfully.
Jul 07 23:03:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:48 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Creating offline snapshot c43137f3-86b5-4f68-bfed-2fd54fb9e6bc of volume cfba7565-af61-4833-9d09-f306eb353d0b {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:03:48 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2afcfa4-dfeb-4a9b-8a05-ad0fc40747d7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:48 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b
Jul 07 23:03:48 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:48 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b" returned: 0 in 0.766s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:48 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc 1G
Jul 07 23:03:48 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:49 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc 1G" returned: 0 in 0.855s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfba7565-af61-4833-9d09-f306eb353d0b -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:49 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfba7565-af61-4833-9d09-f306eb353d0b -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc
Jul 07 23:03:49 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:50 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfba7565-af61-4833-9d09-f306eb353d0b -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc" returned: 0 in 0.735s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:50 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc is being set with open permissions: ugo+rw
Jul 07 23:03:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:50 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc
Jul 07 23:03:50 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:51 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc" returned: 0 in 0.662s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:51 devstack sudo[107653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.info
Jul 07 23:03:51 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:51 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.info" returned: 0 in 0.665s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:51 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.info is being set with open permissions: ugo+rw
Jul 07 23:03:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:51 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.info
Jul 07 23:03:51 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:52 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.info" returned: 0 in 0.698s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.465s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:52 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-26c34ef7-6377-4206-8964-51065cd7b077 tempest-ProjectMemberTests-1327979039 None] Create snapshot completed successfully
Jul 07 23:03:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-c43137f3-86b5-4f68-bfed-2fd54fb9e6bc-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-c43137f3-86b5-4f68-bfed-2fd54fb9e6bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-cfba7565-af61-4833-9d09-f306eb353d0b" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-cfba7565-af61-4833-9d09-f306eb353d0b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-c43137f3-86b5-4f68-bfed-2fd54fb9e6bc" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-c43137f3-86b5-4f68-bfed-2fd54fb9e6bc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Deleting offline snapshot c43137f3-86b5-4f68-bfed-2fd54fb9e6bc of volume cfba7565-af61-4833-9d09-f306eb353d0b {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:03:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] snapshot_file for this snap is: volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:03:53 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[566e7a7a-8f56-47b4-9ea7-4cbd99b1152a]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:53 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc
Jul 07 23:03:53 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:54 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc" returned: 0 in 0.836s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfba7565-af61-4833-9d09-f306eb353d0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:03:54 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff18ac1-a9fe-43a1-94ba-a374a3632eca]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:54 devstack sudo[107665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b
Jul 07 23:03:54 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:55 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b" returned: 0 in 0.821s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:55 devstack sudo[107670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc
Jul 07 23:03:55 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:55 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc" returned: 0 in 0.795s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:55 devstack sudo[107675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc
Jul 07 23:03:55 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:56 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b.c43137f3-86b5-4f68-bfed-2fd54fb9e6bc" returned: 0 in 0.700s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-c43137f3-86b5-4f68-bfed-2fd54fb9e6bc" released by "_delete_snapshot" :: held 3.257s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-cfba7565-af61-4833-9d09-f306eb353d0b" released by "delete_snapshot" :: held 3.291s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:56 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Created reservations ['cc989291-af3c-4f3e-a105-bee2afa2aba4', '6b3b3eac-5b8f-486a-92a3-e7deabb47c04', 'a677ba46-f464-4bd9-a561-26b34aff8586', 'ee0f2491-dcc1-4045-8b58-46462e6039b7'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Delete snapshot completed successfully.
Jul 07 23:03:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-2bc8dba8-356b-45e1-bbeb-8d15b9594df5 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-c43137f3-86b5-4f68-bfed-2fd54fb9e6bc-delete_snapshot" released by "delete_snapshot" :: held 3.463s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-cfba7565-af61-4833-9d09-f306eb353d0b-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-cfba7565-af61-4833-9d09-f306eb353d0b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-cfba7565-af61-4833-9d09-f306eb353d0b" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-cfba7565-af61-4833-9d09-f306eb353d0b" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:57 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a103810-a944-4ea2-a6e5-10df4f28a9fd]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:57 devstack sudo[107678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b
Jul 07 23:03:57 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:58 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b" returned: 0 in 0.857s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:58 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b
Jul 07 23:03:58 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:59 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-cfba7565-af61-4833-9d09-f306eb353d0b" returned: 0 in 0.668s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-cfba7565-af61-4833-9d09-f306eb353d0b" released by "delete_volume" :: held 1.612s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:59 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Created reservations ['80a73031-7ed0-4f77-bf7f-1ed139381fe5', 'ed525e3e-f10d-4dba-9649-449bfe40a10f', 'db8851eb-4b8b-41ce-a544-fd776f594a6a', '30165b94-bb6d-4b0d-87ff-9a27dfc4e981'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:59 devstack sudo[107686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:03:59 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:00 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.700s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Deleted volume successfully.
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b67e07c-b848-4763-b03e-56b6b2eb7fc9 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-cfba7565-af61-4833-9d09-f306eb353d0b-delete_volume" released by "delete_volume" :: held 2.542s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (c372213b-4870-4037-9c04-72ecef0a7636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de8e0d5-0126-4ab9-ae3e-0593f029eb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4de8e0d5-0126-4ab9-ae3e-0593f029eb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2028604525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0ff653-a6d0-49f8-87fd-f713f3da5e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:00Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1620597b-57cb-4b99-a3ed-0dc5f9457694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1620597b-57cb-4b99-a3ed-0dc5f9457694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f3a5f2-ca63-4cd9-84cd-bf7d89eb8f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f3a5f2-ca63-4cd9-84cd-bf7d89eb8f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd0ff653-a6d0-49f8-87fd-f713f3da5e26', 'volume_name': 'volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d2d0b8-27c6-414b-9980-c926e1ef594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d2d0b8-27c6-414b-9980-c926e1ef594e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f024991-731a-4ba3-b78a-fdf73bd34b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:00 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Volume fd0ff653-a6d0-49f8-87fd-f713f3da5e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26', 'volume_size': 1}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2028604525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0ff653-a6d0-49f8-87fd-f713f3da5e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:00Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Creating volume fd0ff653-a6d0-49f8-87fd-f713f3da5e26 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:04:00 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:04:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:00 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 1073741824
Jul 07 23:04:00 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:01 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 1073741824" returned: 0 in 0.804s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:01 devstack sudo[107695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26
Jul 07 23:04:01 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:01 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" returned: 0 in 0.624s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:04:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f024991-731a-4ba3-b78a-fdf73bd34b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c643abf7-7deb-4301-a770-e8b5e64e5f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:01 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Volume volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 (fd0ff653-a6d0-49f8-87fd-f713f3da5e26): created successfully
Jul 07 23:04:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c643abf7-7deb-4301-a770-e8b5e64e5f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (c372213b-4870-4037-9c04-72ecef0a7636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4950e7d3-c8c5-4c7e-bd91-6413b4b44187 tempest-ProjectMemberTests-1327979039 None] Created volume successfully.
Jul 07 23:04:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Creating offline snapshot bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 of volume fd0ff653-a6d0-49f8-87fd-f713f3da5e26 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:04:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aba91a0-8322-4ca5-acc6-839d44b6617c]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:02 devstack sudo[107698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26
Jul 07 23:04:02 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:03 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" returned: 0 in 0.859s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:03 devstack sudo[107703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 1G
Jul 07 23:04:03 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:04 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 1G" returned: 0 in 0.813s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:04 devstack sudo[107708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5
Jul 07 23:04:04 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:05 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5" returned: 0 in 0.673s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:05 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 is being set with open permissions: ugo+rw
Jul 07 23:04:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:05 devstack sudo[107713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5
Jul 07 23:04:05 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:05 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5" returned: 0 in 0.668s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:05 devstack sudo[107716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.info
Jul 07 23:04:05 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:06 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.info" returned: 0 in 0.624s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:06 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.info is being set with open permissions: ugo+rw
Jul 07 23:04:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:06 devstack sudo[107719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.info
Jul 07 23:04:06 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:06 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.info" returned: 0 in 0.598s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.323s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:06 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f4049b21-955e-4c54-8996-30dd26d256db tempest-ProjectMemberTests-1327979039 None] Create snapshot completed successfully
Jul 07 23:04:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-bd9f0efd-26c2-4101-8d14-6b6e6049a9f5-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-bd9f0efd-26c2-4101-8d14-6b6e6049a9f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-bd9f0efd-26c2-4101-8d14-6b6e6049a9f5" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-bd9f0efd-26c2-4101-8d14-6b6e6049a9f5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Deleting offline snapshot bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 of volume fd0ff653-a6d0-49f8-87fd-f713f3da5e26 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:04:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] snapshot_file for this snap is: volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:04:07 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[797b6dbb-4712-4450-b78f-3a3244e53a2d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:08 devstack sudo[107722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5
Jul 07 23:04:08 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:08 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5" returned: 0 in 0.738s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:04:08 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[7725e685-d14b-4da1-9712-e80ee260e102]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:08 devstack sudo[107727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26
Jul 07 23:04:08 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:09 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" returned: 0 in 0.780s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:09 devstack sudo[107732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5
Jul 07 23:04:09 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:10 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5" returned: 0 in 0.735s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:10 devstack sudo[107737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5
Jul 07 23:04:10 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:10 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26.bd9f0efd-26c2-4101-8d14-6b6e6049a9f5" returned: 0 in 0.668s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-bd9f0efd-26c2-4101-8d14-6b6e6049a9f5" released by "_delete_snapshot" :: held 3.020s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" released by "delete_snapshot" :: held 3.048s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:11 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Created reservations ['6ab8db93-a366-4bdd-816f-298eae2abb4a', '35674717-862e-4fb9-9140-a40cf27d34ef', '2e170504-167c-4c6f-81b2-9c38a44cbdc5', '79ac21c6-b4ea-4df5-8e7d-4986545d61e1'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Delete snapshot completed successfully.
Jul 07 23:04:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-149ca21f-296a-48d8-9856-8c9f3a65af56 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-bd9f0efd-26c2-4101-8d14-6b6e6049a9f5-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-fd0ff653-a6d0-49f8-87fd-f713f3da5e26-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Lock "cinder-fd0ff653-a6d0-49f8-87fd-f713f3da5e26-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:12 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[30115717-102b-4275-80b8-8525ca4e7902]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:12 devstack sudo[107741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26
Jul 07 23:04:12 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:13 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" returned: 0 in 0.803s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:13 devstack sudo[107747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26
Jul 07 23:04:13 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:13 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" returned: 0 in 0.673s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-fd0ff653-a6d0-49f8-87fd-f713f3da5e26" released by "delete_volume" :: held 1.532s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Created reservations ['0eed8e4d-90aa-4eb1-b859-11ab90ba7250', '6d483357-534c-4535-9dec-f60a1877492e', '1512d663-9361-42c6-b154-9878455ad533', '10416528-f784-418e-8091-df5bd3eecef5'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:13 devstack sudo[107750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:04:13 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:14 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.635s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:14 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Deleted volume successfully.
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-aeabc5df-1d90-441a-a8fb-e99c6aa39d7e tempest-ProjectMemberTests-1327979039 None] Lock "cinder-fd0ff653-a6d0-49f8-87fd-f713f3da5e26-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (61fce331-c835-4e88-acc4-42647dd97fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20e3842-6055-4855-b3cb-6b58018e8c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20e3842-6055-4855-b3cb-6b58018e8c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1848662073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:15Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75251946-bb13-49ab-8382-b1ca0b2ba1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75251946-bb13-49ab-8382-b1ca0b2ba1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b384a4-4f2b-4897-82b0-e6c8572b6e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b384a4-4f2b-4897-82b0-e6c8572b6e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee', 'volume_name': 'volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4be39a2-0160-4e81-a1df-0c709e097393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4be39a2-0160-4e81-a1df-0c709e097393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe85647-3b8d-42de-bd59-96b2a0b8614b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:14 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Volume 8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee', 'volume_size': 1}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1848662073',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:15Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Creating volume 8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:04:14 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:04:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:14 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee 1073741824
Jul 07 23:04:14 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:15 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee 1073741824" returned: 0 in 0.866s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:15 devstack sudo[107760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee
Jul 07 23:04:15 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:16 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" returned: 0 in 0.655s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:04:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe85647-3b8d-42de-bd59-96b2a0b8614b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2562e3a6-7111-4832-878b-d78e8b36a350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:16 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Volume volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee (8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee): created successfully
Jul 07 23:04:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2562e3a6-7111-4832-878b-d78e8b36a350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (61fce331-c835-4e88-acc4-42647dd97fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1194d80e-583d-4544-b300-dba80accc392 tempest-ProjectMemberTests-1327979039 None] Created volume successfully.
Jul 07 23:04:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:17 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Creating offline snapshot e93b0445-f74e-4fae-84c5-672be53db337 of volume 8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:04:17 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1028ed9c-677e-4877-afc7-134bcdc05a47]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:17 devstack sudo[107763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee
Jul 07 23:04:17 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:17 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" returned: 0 in 0.812s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:17 devstack sudo[107768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337 1G
Jul 07 23:04:17 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:18 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337 1G" returned: 0 in 0.808s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:18 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337
Jul 07 23:04:18 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:19 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337" returned: 0 in 0.706s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:19 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337 is being set with open permissions: ugo+rw
Jul 07 23:04:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:19 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337
Jul 07 23:04:19 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:20 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337" returned: 0 in 0.671s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:20 devstack sudo[107783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.info
Jul 07 23:04:20 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:20 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.info" returned: 0 in 0.704s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:20 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.info is being set with open permissions: ugo+rw
Jul 07 23:04:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:20 devstack sudo[107786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.info
Jul 07 23:04:20 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:21 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.info" returned: 0 in 0.662s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.457s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:21 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b39cdb1f-88ab-49b7-9edc-554d88d76268 tempest-ProjectMemberTests-1327979039 None] Create snapshot completed successfully
Jul 07 23:04:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-e93b0445-f74e-4fae-84c5-672be53db337-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-e93b0445-f74e-4fae-84c5-672be53db337-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-e93b0445-f74e-4fae-84c5-672be53db337" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:22 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-e93b0445-f74e-4fae-84c5-672be53db337" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Deleting offline snapshot e93b0445-f74e-4fae-84c5-672be53db337 of volume 8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:04:22 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] snapshot_file for this snap is: volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:04:22 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd9016b-f78c-4c9a-87c6-695ab14fd72e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:22 devstack sudo[107790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337
Jul 07 23:04:22 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:23 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337" returned: 0 in 0.831s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:23 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:04:23 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e206fcf1-79d1-4acd-b428-19d57b2b25cc]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:23 devstack sudo[107795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee
Jul 07 23:04:23 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:24 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" returned: 0 in 0.798s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:24 devstack sudo[107800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337
Jul 07 23:04:24 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:24 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337" returned: 0 in 0.750s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:24 devstack sudo[107805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337
Jul 07 23:04:24 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:25 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee.e93b0445-f74e-4fae-84c5-672be53db337" returned: 0 in 0.691s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-e93b0445-f74e-4fae-84c5-672be53db337" released by "_delete_snapshot" :: held 3.173s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" released by "delete_snapshot" :: held 3.197s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:25 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Created reservations ['5c45eee8-9338-417d-9a37-020acf0183b9', 'e4e1a727-9fec-445a-85cb-716d8231fa23', '8f1d06f7-64c5-4b31-a9e5-3a8ec038d1c6', '9b93d41c-ff85-46b2-b59a-51c8b9602512'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:25 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Delete snapshot completed successfully.
Jul 07 23:04:25 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-b3ca1f49-f926-4577-a910-836c13f04a0b tempest-ProjectMemberTests-1327979039 None] Lock "cinder-e93b0445-f74e-4fae-84c5-672be53db337-delete_snapshot" released by "delete_snapshot" :: held 3.354s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:26 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:26 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10f8e63-8bb9-4a13-894e-88e718e63679]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:26 devstack sudo[107844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee
Jul 07 23:04:26 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:27 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" returned: 0 in 0.768s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:27 devstack sudo[107850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee
Jul 07 23:04:27 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:28 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" returned: 0 in 0.638s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee" released by "delete_volume" :: held 1.472s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:28 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Created reservations ['001c81e8-4129-4f8e-b25d-cb1215b5127f', '8c706fe7-3582-4a02-9e76-487313a71dfe', 'f5a982af-b868-4058-b874-612ec55a6634', 'b0538028-0b54-4d39-8399-12c75943d152'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:28 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:28 devstack sudo[107853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:04:28 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:29 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.759s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:29 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Deleted volume successfully.
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ab07bc15-0b99-465c-ac22-2639aa701785 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-8a5ae1ce-fa77-49e1-8b93-ca2d75a48eee-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (9a45209f-bbe4-4f35-870b-cbe60f30f319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bc7fac-525f-43d1-bbc1-3257828d717f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62bc7fac-525f-43d1-bbc1-3257828d717f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1820859475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830c3c05-8d53-4875-95ea-ff0fa4618255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:29Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac7829d-3621-4a1b-9205-ba0133cb5c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac7829d-3621-4a1b-9205-ba0133cb5c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdde9657-0896-41a7-8a81-d64c2036fa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdde9657-0896-41a7-8a81-d64c2036fa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830c3c05-8d53-4875-95ea-ff0fa4618255', 'volume_name': 'volume-830c3c05-8d53-4875-95ea-ff0fa4618255', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164314ac-e89b-48d4-b625-4469d797d5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (164314ac-e89b-48d4-b625-4469d797d5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9106e8b5-a18f-4e37-a141-a618c785a55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:29 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Volume 830c3c05-8d53-4875-95ea-ff0fa4618255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830c3c05-8d53-4875-95ea-ff0fa4618255', 'volume_size': 1}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1820859475',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830c3c05-8d53-4875-95ea-ff0fa4618255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:29Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Creating volume 830c3c05-8d53-4875-95ea-ff0fa4618255 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:04:29 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:04:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:29 devstack sudo[107856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255 1073741824
Jul 07 23:04:29 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:30 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255 1073741824" returned: 0 in 0.793s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:30 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255
Jul 07 23:04:30 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:30 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255" returned: 0 in 0.651s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:04:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9106e8b5-a18f-4e37-a141-a618c785a55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830c3c05-8d53-4875-95ea-ff0fa4618255', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968e2068-b116-4a0c-a146-d746d22c9251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:30 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Volume volume-830c3c05-8d53-4875-95ea-ff0fa4618255 (830c3c05-8d53-4875-95ea-ff0fa4618255): created successfully
Jul 07 23:04:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968e2068-b116-4a0c-a146-d746d22c9251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:30 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (9a45209f-bbe4-4f35-870b-cbe60f30f319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:30 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1bc23bb5-98e3-4086-9aab-c1443a74fe7c tempest-ProjectMemberTests-1327979039 None] Created volume successfully.
Jul 07 23:04:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Creating offline snapshot 1569daa6-8f02-402d-8bed-f1f4534b900f of volume 830c3c05-8d53-4875-95ea-ff0fa4618255 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:04:31 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ed1fb4-a1e8-4c20-a05f-f8468a12a3ab]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:31 devstack sudo[107865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255
Jul 07 23:04:31 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:32 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255" returned: 0 in 0.769s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:32 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f 1G
Jul 07 23:04:32 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:33 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f 1G" returned: 0 in 0.823s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830c3c05-8d53-4875-95ea-ff0fa4618255 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:33 devstack sudo[107875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830c3c05-8d53-4875-95ea-ff0fa4618255 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f
Jul 07 23:04:33 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:33 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830c3c05-8d53-4875-95ea-ff0fa4618255 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f" returned: 0 in 0.798s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:33 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f is being set with open permissions: ugo+rw
Jul 07 23:04:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:34 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f
Jul 07 23:04:34 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:34 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f" returned: 0 in 0.705s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:34 devstack sudo[107883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.info
Jul 07 23:04:34 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:35 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.info" returned: 0 in 0.690s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:35 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.info is being set with open permissions: ugo+rw
Jul 07 23:04:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:35 devstack sudo[107886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.info
Jul 07 23:04:35 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:36 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.info" returned: 0 in 0.685s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.560s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:36 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-dde9bebf-fdea-4f12-90c0-00c7dff0f36c tempest-ProjectMemberTests-1327979039 None] Create snapshot completed successfully
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-1569daa6-8f02-402d-8bed-f1f4534b900f-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-1569daa6-8f02-402d-8bed-f1f4534b900f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-830c3c05-8d53-4875-95ea-ff0fa4618255" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-830c3c05-8d53-4875-95ea-ff0fa4618255" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-1569daa6-8f02-402d-8bed-f1f4534b900f" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-1569daa6-8f02-402d-8bed-f1f4534b900f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Deleting offline snapshot 1569daa6-8f02-402d-8bed-f1f4534b900f of volume 830c3c05-8d53-4875-95ea-ff0fa4618255 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] snapshot_file for this snap is: volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c630b173-9984-48b8-b408-969b5813f24e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:37 devstack sudo[107889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f
Jul 07 23:04:37 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:37 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f" returned: 0 in 0.780s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:37 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830c3c05-8d53-4875-95ea-ff0fa4618255(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:04:37 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a285c29-7bc9-4765-a25d-dc3842cdc0a4]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:37 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255
Jul 07 23:04:37 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:38 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255" returned: 0 in 0.782s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:38 devstack sudo[107899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f
Jul 07 23:04:38 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:39 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f" returned: 0 in 0.704s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:39 devstack sudo[107904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f
Jul 07 23:04:39 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:39 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255.1569daa6-8f02-402d-8bed-f1f4534b900f" returned: 0 in 0.626s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-1569daa6-8f02-402d-8bed-f1f4534b900f" released by "_delete_snapshot" :: held 2.986s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:39 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-830c3c05-8d53-4875-95ea-ff0fa4618255" released by "delete_snapshot" :: held 3.014s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:39 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Created reservations ['8fe17fb0-2903-45c2-b133-8fa7168d8c8b', '28206857-0e10-4710-ac73-b5a72396b28b', 'e82dea0e-6e1d-4ecd-918b-1f25d882b9e1', 'c40db91d-e6e4-4917-b01f-e1856fafb2f9'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:40 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Delete snapshot completed successfully.
Jul 07 23:04:40 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-7eb61846-9070-499c-aac5-16924900eee3 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-1569daa6-8f02-402d-8bed-f1f4534b900f-delete_snapshot" released by "delete_snapshot" :: held 3.166s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-830c3c05-8d53-4875-95ea-ff0fa4618255-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Lock "cinder-830c3c05-8d53-4875-95ea-ff0fa4618255-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-830c3c05-8d53-4875-95ea-ff0fa4618255" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-830c3c05-8d53-4875-95ea-ff0fa4618255" acquired by "delete_volume" :: waited 0.028s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:41 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4f3e0e-c556-48a1-b328-68e6a4b00205]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:41 devstack sudo[107908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255
Jul 07 23:04:41 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:41 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255" returned: 0 in 0.774s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:41 devstack sudo[107913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255
Jul 07 23:04:41 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:42 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:42 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-830c3c05-8d53-4875-95ea-ff0fa4618255" returned: 0 in 0.920s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-830c3c05-8d53-4875-95ea-ff0fa4618255" released by "delete_volume" :: held 1.755s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:42 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Created reservations ['fd740f2b-4011-4f36-855f-0a16dbbefb47', 'b90ad290-d5b4-466a-9926-1572a2c8a602', 'a87bc11e-db5d-4f67-a9fe-05187cc53436', '847d4202-bfaf-4f82-9fd8-5b5a143cf6a2'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:43 devstack sudo[107916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:04:43 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:43 devstack sudo[107918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:04:43 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:43 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.749s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:43 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Deleted volume successfully.
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-3f08794f-97e6-4781-825e-5e35fe927aca tempest-ProjectMemberTests-1327979039 None] Lock "cinder-830c3c05-8d53-4875-95ea-ff0fa4618255-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (ee931be0-458c-42ab-b07c-68649251d367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ca4e9f-8e3d-478e-979d-a684147162e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ca4e9f-8e3d-478e-979d-a684147162e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789443089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6daec7f9-8cc4-4deb-8fef-38dd773c3d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:44Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce670b1c-0de7-4faf-bdd1-18bf862a399d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce670b1c-0de7-4faf-bdd1-18bf862a399d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c6077a-e8dd-4bfc-80f6-5b066e481c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8c6077a-e8dd-4bfc-80f6-5b066e481c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6daec7f9-8cc4-4deb-8fef-38dd773c3d1f', 'volume_name': 'volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f89988-253c-4332-9af6-dedc4e35ec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f89988-253c-4332-9af6-dedc4e35ec54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0aae73-93c7-4f83-b8f2-e215930746d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:43 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Volume 6daec7f9-8cc4-4deb-8fef-38dd773c3d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f', 'volume_size': 1}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789443089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6daec7f9-8cc4-4deb-8fef-38dd773c3d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f22ce7c7d90742b897161df7e01bd4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:44Z,use_quota=True,user_id='05ab88f652574055beda650bd9c978e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Creating volume 6daec7f9-8cc4-4deb-8fef-38dd773c3d1f {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:04:43 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:04:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:43 devstack sudo[107921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f 1073741824
Jul 07 23:04:43 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:44 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.689s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:04:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:04:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:04:44 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f 1073741824" returned: 0 in 0.845s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:44 devstack sudo[107927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f
Jul 07 23:04:44 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:45 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" returned: 0 in 0.655s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] <== create_volume: return (1540ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:04:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c0aae73-93c7-4f83-b8f2-e215930746d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2b0de8-822b-4a26-8d95-d96b02147d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:45 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Volume volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f (6daec7f9-8cc4-4deb-8fef-38dd773c3d1f): created successfully
Jul 07 23:04:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2b0de8-822b-4a26-8d95-d96b02147d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Flow 'volume_create_manager' (ee931be0-458c-42ab-b07c-68649251d367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:45 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-cc37454e-2a8e-424d-8729-e25fe9e1c847 tempest-ProjectMemberTests-1327979039 None] Created volume successfully.
Jul 07 23:04:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:46 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Creating offline snapshot c6a1abb7-8d71-48c9-91dc-d091ff967ab8 of volume 6daec7f9-8cc4-4deb-8fef-38dd773c3d1f {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:04:46 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e42021-f7c5-4990-8940-a421fdb28d01]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:46 devstack sudo[107936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f
Jul 07 23:04:46 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:46 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" returned: 0 in 0.753s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:46 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8 1G
Jul 07 23:04:46 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:47 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8 1G" returned: 0 in 0.797s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:47 devstack sudo[107947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8
Jul 07 23:04:47 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:48 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8" returned: 0 in 0.811s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:48 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8 is being set with open permissions: ugo+rw
Jul 07 23:04:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:48 devstack sudo[107952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8
Jul 07 23:04:48 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:49 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8" returned: 0 in 0.780s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:49 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=51,cinder:INSERT=20,cinder:UPDATE=79,cinder:DELETE=4 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:04:49 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:UPDATE=71,cinder:DELETE=9,cinder:SELECT=65,cinder:INSERT=21 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:04:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:49 devstack sudo[107955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.info
Jul 07 23:04:49 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:50 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.info" returned: 0 in 0.720s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:50 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.info is being set with open permissions: ugo+rw
Jul 07 23:04:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:50 devstack sudo[107958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.info
Jul 07 23:04:50 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:50 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.info" returned: 0 in 0.815s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.769s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:50 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-14176bac-79d7-4e48-ac4c-c97ef76379a6 tempest-ProjectMemberTests-1327979039 None] Create snapshot completed successfully
Jul 07 23:04:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-c6a1abb7-8d71-48c9-91dc-d091ff967ab8-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-c6a1abb7-8d71-48c9-91dc-d091ff967ab8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-c6a1abb7-8d71-48c9-91dc-d091ff967ab8" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:51 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-c6a1abb7-8d71-48c9-91dc-d091ff967ab8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Deleting offline snapshot c6a1abb7-8d71-48c9-91dc-d091ff967ab8 of volume 6daec7f9-8cc4-4deb-8fef-38dd773c3d1f {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:04:51 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] snapshot_file for this snap is: volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:04:51 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d0ccec-30e1-4af6-9071-2e0852b1c446]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:51 devstack sudo[107962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8
Jul 07 23:04:51 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:52 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8" returned: 0 in 0.952s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:52 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:04:52 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[84791400-3908-45ef-9299-5cbf02342f7e]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:52 devstack sudo[107967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f
Jul 07 23:04:52 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:53 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" returned: 0 in 0.822s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:53 devstack sudo[107972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8
Jul 07 23:04:53 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:54 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8" returned: 0 in 0.786s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:54 devstack sudo[107977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8
Jul 07 23:04:54 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:54 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f.c6a1abb7-8d71-48c9-91dc-d091ff967ab8" returned: 0 in 0.651s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:54 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-c6a1abb7-8d71-48c9-91dc-d091ff967ab8" released by "_delete_snapshot" :: held 3.321s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:54 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" released by "delete_snapshot" :: held 3.349s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:54 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Created reservations ['9dcbc09d-5146-4922-9b81-d2515948ffee', 'b8ab4e5e-ea84-439c-8899-6f711cba1f7d', '5c6f4d8f-3490-4950-8e6c-dbe91fa5aa8b', '8c428dc7-4372-4846-873b-aba0973241d5'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:55 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Delete snapshot completed successfully.
Jul 07 23:04:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-43bb8d63-1f35-435b-baf0-98d448890a14 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-c6a1abb7-8d71-48c9-91dc-d091ff967ab8-delete_snapshot" released by "delete_snapshot" :: held 3.501s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "cinder-quobyte-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:55 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:55 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e450910-e64f-47f6-9c2c-0fdfcdcd5451]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:55 devstack sudo[107980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f
Jul 07 23:04:55 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:56 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" returned: 0 in 0.822s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:56 devstack sudo[107985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f
Jul 07 23:04:56 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:57 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" returned: 0 in 0.635s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-quobyte-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f" released by "delete_volume" :: held 1.512s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:57 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Created reservations ['e67ac3b1-0833-4f41-89a7-4d2fd47d7d81', 'a7bfcb73-5964-4a44-bc47-357a2f88a21d', 'eb60fa4f-e3f5-49c3-a723-5da999f155c0', '1ea8e264-d169-46be-a1fd-d5c1ceca475d'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:57 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:57 devstack sudo[107988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:04:57 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:58 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.694s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:58 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:58 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Deleted volume successfully.
Jul 07 23:04:58 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-ea8a995e-36ad-4574-a031-d811ae115ab1 tempest-ProjectMemberTests-1327979039 None] Lock "cinder-6daec7f9-8cc4-4deb-8fef-38dd773c3d1f-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Flow 'volume_create_manager' (37f25fbe-90db-4b2b-9ad9-67c21f94d50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f24f809-1041-48e9-9f42-1a7ac92f0c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f24f809-1041-48e9-9f42-1a7ac92f0c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-465749519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d16817d-eeb3-40bb-aaff-5d2eb52cc59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19186598f11a4905b8dab9c2ff3b70ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:02Z,use_quota=True,user_id='2b6e8b9d6f2145bdb994498d24e1b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374e580c-0fef-412a-9646-469a433ee966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374e580c-0fef-412a-9646-469a433ee966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61dc8ec-771d-438d-9321-6706540bddea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61dc8ec-771d-438d-9321-6706540bddea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d16817d-eeb3-40bb-aaff-5d2eb52cc59f', 'volume_name': 'volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd37801-1773-4681-ad2b-c54e56b107c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd37801-1773-4681-ad2b-c54e56b107c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9acbf70-4f5b-4c48-bd1c-3badde656e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:02 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Volume 7d16817d-eeb3-40bb-aaff-5d2eb52cc59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f', 'volume_size': 1}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-465749519',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d16817d-eeb3-40bb-aaff-5d2eb52cc59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19186598f11a4905b8dab9c2ff3b70ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:02Z,use_quota=True,user_id='2b6e8b9d6f2145bdb994498d24e1b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Creating volume 7d16817d-eeb3-40bb-aaff-5d2eb52cc59f {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:05:02 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:05:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:02 devstack sudo[107996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f 1073741824
Jul 07 23:05:02 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:03 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f 1073741824" returned: 0 in 0.900s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:03 devstack sudo[108002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f
Jul 07 23:05:03 devstack sudo[108002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:03 devstack sudo[108002]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" returned: 0 in 0.695s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:03 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:05:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9acbf70-4f5b-4c48-bd1c-3badde656e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37438a6-0e3a-4d81-8338-06de7e34b250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:03 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Volume volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f (7d16817d-eeb3-40bb-aaff-5d2eb52cc59f): created successfully
Jul 07 23:05:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37438a6-0e3a-4d81-8338-06de7e34b250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:03 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Flow 'volume_create_manager' (37f25fbe-90db-4b2b-9ad9-67c21f94d50e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:04 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3d8171b7-f739-4f87-8ace-2e98d0e9fb6d tempest-ProjectReaderTests-207751941 None] Created volume successfully.
Jul 07 23:05:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:04 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Creating offline snapshot dd5ba6be-649f-44aa-ace8-069fd407257b of volume 7d16817d-eeb3-40bb-aaff-5d2eb52cc59f {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:05:04 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7f8c04-f120-4bd8-abb8-14a26df3e6bf]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:04 devstack sudo[108005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f
Jul 07 23:05:04 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:05 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" returned: 0 in 0.897s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:05 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b 1G
Jul 07 23:05:05 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:06 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b 1G" returned: 0 in 0.787s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:06 devstack sudo[108015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b
Jul 07 23:05:06 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:06 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b" returned: 0 in 0.664s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:06 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b is being set with open permissions: ugo+rw
Jul 07 23:05:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:06 devstack sudo[108022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b
Jul 07 23:05:06 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:07 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b" returned: 0 in 0.643s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:07 devstack sudo[108025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.info
Jul 07 23:05:07 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:08 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.info" returned: 0 in 0.692s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:08 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.info is being set with open permissions: ugo+rw
Jul 07 23:05:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:08 devstack sudo[108028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.info
Jul 07 23:05:08 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:08 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.info" returned: 0 in 0.636s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.407s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:08 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4177c079-3e06-4305-9033-b4ee5653ef84 tempest-ProjectReaderTests-207751941 None] Create snapshot completed successfully
Jul 07 23:05:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-dd5ba6be-649f-44aa-ace8-069fd407257b-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-dd5ba6be-649f-44aa-ace8-069fd407257b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-dd5ba6be-649f-44aa-ace8-069fd407257b" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:09 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-dd5ba6be-649f-44aa-ace8-069fd407257b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Deleting offline snapshot dd5ba6be-649f-44aa-ace8-069fd407257b of volume 7d16817d-eeb3-40bb-aaff-5d2eb52cc59f {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:05:09 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] snapshot_file for this snap is: volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:05:09 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02cb3e6-4ce3-40d8-b924-3e3a3ca14386]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:09 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b
Jul 07 23:05:09 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:10 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b" returned: 0 in 0.766s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:10 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:05:10 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3f633f-1a02-4945-aeca-fb9b2f3ae3aa]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:10 devstack sudo[108036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f
Jul 07 23:05:10 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:11 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" returned: 0 in 0.783s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:11 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:11 devstack sudo[108042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b
Jul 07 23:05:11 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:12 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b" returned: 0 in 0.742s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:12 devstack sudo[108047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b
Jul 07 23:05:12 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:12 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f.dd5ba6be-649f-44aa-ace8-069fd407257b" returned: 0 in 0.649s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-dd5ba6be-649f-44aa-ace8-069fd407257b" released by "_delete_snapshot" :: held 3.033s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" released by "delete_snapshot" :: held 3.055s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:12 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Created reservations ['e8b279e2-e8dd-44da-b67b-3936c74f37eb', '407343b4-4051-4183-b831-bce458b4ad15', '6ff1f61f-39d3-4156-95fd-12c99436382a', '430d054d-df20-474a-a200-cf17fe304471'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:05:12 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Delete snapshot completed successfully.
Jul 07 23:05:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-c585b3e2-1bd5-40e2-98fe-47878b41feb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-dd5ba6be-649f-44aa-ace8-069fd407257b-delete_snapshot" released by "delete_snapshot" :: held 3.193s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Lock "cinder-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:14 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[55234d34-55ef-418a-b863-5454c4eadf77]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:14 devstack sudo[108051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f
Jul 07 23:05:14 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:14 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" returned: 0 in 0.872s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:15 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f
Jul 07 23:05:15 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:15 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" returned: 0 in 0.713s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:15 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f" released by "delete_volume" :: held 1.648s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:15 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Created reservations ['c9cdbaca-b427-4b0b-afb8-c415f8c4d1b1', 'c80b9fc8-0388-4258-a74c-53db9fb62968', 'db725e82-e97f-4491-844a-dad9e771987d', '277b6390-b1a9-4f03-9750-537ac2f5cd9a'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:05:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:15 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:15 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:15 devstack sudo[108061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:05:15 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:16 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.740s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:05:16 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Deleted volume successfully.
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-f7565db9-9c45-48e3-b363-a2a902972485 tempest-ProjectReaderTests-207751941 None] Lock "cinder-7d16817d-eeb3-40bb-aaff-5d2eb52cc59f-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Flow 'volume_create_manager' (859c3bb3-2b6a-463c-9e0f-eb92636bc05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9269937-8321-4e4b-a986-ba02fc580635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9269937-8321-4e4b-a986-ba02fc580635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1943052118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3faed118-f8f1-4a1c-83d2-f44e44e22172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19186598f11a4905b8dab9c2ff3b70ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:17Z,use_quota=True,user_id='2b6e8b9d6f2145bdb994498d24e1b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e14e40-c63c-4138-bf63-af6d00e49849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e14e40-c63c-4138-bf63-af6d00e49849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090fbb78-99fe-4313-a179-b61e46f22d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090fbb78-99fe-4313-a179-b61e46f22d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3faed118-f8f1-4a1c-83d2-f44e44e22172', 'volume_name': 'volume-3faed118-f8f1-4a1c-83d2-f44e44e22172', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ce7c33-3a78-4f11-ab42-e5f770701f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ce7c33-3a78-4f11-ab42-e5f770701f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10b17e1-99d1-4c04-bbc5-1a18085145aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:16 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Volume 3faed118-f8f1-4a1c-83d2-f44e44e22172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3faed118-f8f1-4a1c-83d2-f44e44e22172', 'volume_size': 1}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1943052118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3faed118-f8f1-4a1c-83d2-f44e44e22172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19186598f11a4905b8dab9c2ff3b70ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:17Z,use_quota=True,user_id='2b6e8b9d6f2145bdb994498d24e1b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Creating volume 3faed118-f8f1-4a1c-83d2-f44e44e22172 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:05:16 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:05:16 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:16 devstack sudo[108064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 1073741824
Jul 07 23:05:16 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:17 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 1073741824" returned: 0 in 0.847s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:17 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:17 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172
Jul 07 23:05:17 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:18 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172" returned: 0 in 0.641s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:18 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:05:18 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a10b17e1-99d1-4c04-bbc5-1a18085145aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3faed118-f8f1-4a1c-83d2-f44e44e22172', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78d2c48-0f2a-4cf9-9182-16a3c677b2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:18 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Volume volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 (3faed118-f8f1-4a1c-83d2-f44e44e22172): created successfully
Jul 07 23:05:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78d2c48-0f2a-4cf9-9182-16a3c677b2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:18 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Flow 'volume_create_manager' (859c3bb3-2b6a-463c-9e0f-eb92636bc05b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:18 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-2456b43a-5a47-4fae-a015-7a57eb1ea41f tempest-ProjectReaderTests-207751941 None] Created volume successfully.
Jul 07 23:05:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:19 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Creating offline snapshot bd298cb1-c99a-4031-810a-a85631e63191 of volume 3faed118-f8f1-4a1c-83d2-f44e44e22172 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:05:19 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e6c0da-2705-4b29-91c6-aacc65d8b234]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:19 devstack sudo[108072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172
Jul 07 23:05:19 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:19 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172" returned: 0 in 0.790s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:19 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:19 devstack sudo[108077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191 1G
Jul 07 23:05:19 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:20 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191 1G" returned: 0 in 0.809s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:20 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:20 devstack sudo[108083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191
Jul 07 23:05:20 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:21 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191" returned: 0 in 0.704s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:21 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191 is being set with open permissions: ugo+rw
Jul 07 23:05:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:21 devstack sudo[108089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191
Jul 07 23:05:21 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:21 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:21 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191" returned: 0 in 0.635s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:22 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.info
Jul 07 23:05:22 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:22 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.info" returned: 0 in 0.646s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:22 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.info is being set with open permissions: ugo+rw
Jul 07 23:05:22 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:22 devstack sudo[108095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.info
Jul 07 23:05:22 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:23 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.info" returned: 0 in 0.674s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:23 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.335s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:23 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-3016d3b5-daf1-4d60-90ab-94c824bbf13c tempest-ProjectReaderTests-207751941 None] Create snapshot completed successfully
Jul 07 23:05:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-bd298cb1-c99a-4031-810a-a85631e63191-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Lock "cinder-bd298cb1-c99a-4031-810a-a85631e63191-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-3faed118-f8f1-4a1c-83d2-f44e44e22172" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-3faed118-f8f1-4a1c-83d2-f44e44e22172" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-bd298cb1-c99a-4031-810a-a85631e63191" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:24 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-bd298cb1-c99a-4031-810a-a85631e63191" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Deleting offline snapshot bd298cb1-c99a-4031-810a-a85631e63191 of volume 3faed118-f8f1-4a1c-83d2-f44e44e22172 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:05:24 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] snapshot_file for this snap is: volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:05:24 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6df6507-25d4-46f6-b3b7-84127b2761f1]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:24 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:24 devstack sudo[108098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191
Jul 07 23:05:24 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:25 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191" returned: 0 in 0.789s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:25 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3faed118-f8f1-4a1c-83d2-f44e44e22172(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:05:25 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2105ba9b-e999-468a-bf8d-fed77e614dcc]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:25 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172
Jul 07 23:05:25 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:25 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172" returned: 0 in 0.824s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:25 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:25 devstack sudo[108109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191
Jul 07 23:05:25 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:26 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191" returned: 0 in 0.828s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:26 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:26 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191
Jul 07 23:05:26 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:27 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:27 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172.bd298cb1-c99a-4031-810a-a85631e63191" returned: 0 in 0.703s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-bd298cb1-c99a-4031-810a-a85631e63191" released by "_delete_snapshot" :: held 3.237s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-3faed118-f8f1-4a1c-83d2-f44e44e22172" released by "delete_snapshot" :: held 3.261s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:27 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Created reservations ['2a54a8f9-4acf-4a10-83bf-eb37a7f8f51b', '5e26dcf7-6b3e-4013-8d27-18797671199e', '70d812bc-5640-4211-aeb0-8c99bd83ec65', '4b5bff9b-82e2-408e-8b7e-472b21582088'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:05:27 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Delete snapshot completed successfully.
Jul 07 23:05:27 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-32832f7d-41c1-4c17-9b9d-445ad75737b0 tempest-ProjectReaderTests-207751941 None] Lock "cinder-bd298cb1-c99a-4031-810a-a85631e63191-delete_snapshot" released by "delete_snapshot" :: held 3.413s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-3faed118-f8f1-4a1c-83d2-f44e44e22172-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Lock "cinder-3faed118-f8f1-4a1c-83d2-f44e44e22172-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-3faed118-f8f1-4a1c-83d2-f44e44e22172" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:28 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-3faed118-f8f1-4a1c-83d2-f44e44e22172" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:28 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[300cdf86-58be-4aba-a736-c7fab5b149c8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:28 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:28 devstack sudo[108155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172
Jul 07 23:05:28 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:29 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172" returned: 0 in 0.855s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:29 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:29 devstack sudo[108161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172
Jul 07 23:05:29 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:30 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-3faed118-f8f1-4a1c-83d2-f44e44e22172" returned: 0 in 0.701s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-3faed118-f8f1-4a1c-83d2-f44e44e22172" released by "delete_volume" :: held 1.616s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Created reservations ['a5b6f54a-98e9-41fd-a5ef-2944e474483c', 'e38b3dcb-6de5-475b-8c93-f991e5cf5461', '2d37fadf-4a0d-49bc-822e-750649c593bf', '39427f70-9434-476a-beca-9bf19b85976b'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:30 devstack sudo[108164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:05:30 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:30 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.665s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:05:30 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Deleted volume successfully.
Jul 07 23:05:30 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-0a2b158a-aa33-4f09-b6d9-4108986d0d97 tempest-ProjectReaderTests-207751941 None] Lock "cinder-3faed118-f8f1-4a1c-83d2-f44e44e22172-delete_volume" released by "delete_volume" :: held 2.506s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Flow 'volume_create_manager' (0ef4a031-5773-4bb0-b7d9-5784b00103b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffb72a6-b817-4bf7-bb14-d95db67477d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffb72a6-b817-4bf7-bb14-d95db67477d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844227831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e081db4f-bf81-4afa-936b-e423a863bbae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19186598f11a4905b8dab9c2ff3b70ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:31Z,use_quota=True,user_id='2b6e8b9d6f2145bdb994498d24e1b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf83b1f3-ebdf-4be2-a4cd-b05745129ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf83b1f3-ebdf-4be2-a4cd-b05745129ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f159af-ef7f-4ed8-8844-84568e133ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f159af-ef7f-4ed8-8844-84568e133ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e081db4f-bf81-4afa-936b-e423a863bbae', 'volume_name': 'volume-e081db4f-bf81-4afa-936b-e423a863bbae', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6549579a-de6a-4e55-9b3e-147b2e1e92c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6549579a-de6a-4e55-9b3e-147b2e1e92c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13440ed4-3ff4-49f8-b6e8-ddf1cae42016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:31 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Volume e081db4f-bf81-4afa-936b-e423a863bbae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e081db4f-bf81-4afa-936b-e423a863bbae', 'volume_size': 1}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1844227831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e081db4f-bf81-4afa-936b-e423a863bbae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19186598f11a4905b8dab9c2ff3b70ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:31Z,use_quota=True,user_id='2b6e8b9d6f2145bdb994498d24e1b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Creating volume e081db4f-bf81-4afa-936b-e423a863bbae {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:05:31 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:05:31 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:31 devstack sudo[108168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae 1073741824
Jul 07 23:05:31 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:32 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae 1073741824" returned: 0 in 0.906s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:32 devstack sudo[108174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae
Jul 07 23:05:32 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:32 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae" returned: 0 in 0.684s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:32 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:05:32 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:32 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13440ed4-3ff4-49f8-b6e8-ddf1cae42016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e081db4f-bf81-4afa-936b-e423a863bbae', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc720a52-8c6a-4ba7-a894-1de7d9f6b838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:33 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Volume volume-e081db4f-bf81-4afa-936b-e423a863bbae (e081db4f-bf81-4afa-936b-e423a863bbae): created successfully
Jul 07 23:05:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc720a52-8c6a-4ba7-a894-1de7d9f6b838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:33 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Flow 'volume_create_manager' (0ef4a031-5773-4bb0-b7d9-5784b00103b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:33 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-5e4f66cc-e3c8-4235-8ec5-a74b48a5bce4 tempest-ProjectReaderTests-207751941 None] Created volume successfully.
Jul 07 23:05:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:33 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Creating offline snapshot 9f8464c4-7220-4d0e-9edd-7529114e6c33 of volume e081db4f-bf81-4afa-936b-e423a863bbae {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:05:33 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e23641-3c7c-4bdf-9339-ea5185f02bdf]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:33 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:33 devstack sudo[108177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae
Jul 07 23:05:33 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:34 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae" returned: 0 in 0.791s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:34 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:34 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33 1G
Jul 07 23:05:34 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:35 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33 1G" returned: 0 in 0.829s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e081db4f-bf81-4afa-936b-e423a863bbae -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:35 devstack sudo[108187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e081db4f-bf81-4afa-936b-e423a863bbae -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33
Jul 07 23:05:35 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:35 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e081db4f-bf81-4afa-936b-e423a863bbae -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33" returned: 0 in 0.698s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:35 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33 is being set with open permissions: ugo+rw
Jul 07 23:05:35 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:35 devstack sudo[108192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33
Jul 07 23:05:35 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:36 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33" returned: 0 in 0.656s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:36 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:36 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.info
Jul 07 23:05:36 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:37 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.info" returned: 0 in 0.648s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:37 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.info is being set with open permissions: ugo+rw
Jul 07 23:05:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:37 devstack sudo[108198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.info
Jul 07 23:05:37 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:37 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.info" returned: 0 in 0.670s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:37 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.372s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:37 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-f9471b92-aa15-4d5f-a458-d9b21ca84b8c tempest-ProjectReaderTests-207751941 None] Create snapshot completed successfully
Jul 07 23:05:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-9f8464c4-7220-4d0e-9edd-7529114e6c33-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Lock "cinder-9f8464c4-7220-4d0e-9edd-7529114e6c33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-e081db4f-bf81-4afa-936b-e423a863bbae" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-e081db4f-bf81-4afa-936b-e423a863bbae" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-9f8464c4-7220-4d0e-9edd-7529114e6c33" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:38 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-9f8464c4-7220-4d0e-9edd-7529114e6c33" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Deleting offline snapshot 9f8464c4-7220-4d0e-9edd-7529114e6c33 of volume e081db4f-bf81-4afa-936b-e423a863bbae {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:05:38 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] snapshot_file for this snap is: volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:05:38 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52e585f-4714-46bd-94ef-9ffb2675b8a1]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:38 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:38 devstack sudo[108201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33
Jul 07 23:05:38 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:39 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33" returned: 0 in 0.763s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:39 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e081db4f-bf81-4afa-936b-e423a863bbae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:05:39 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[431b3314-9a72-405d-a5a8-a9230be3d4f8]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:39 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:39 devstack sudo[108206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae
Jul 07 23:05:39 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:40 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae" returned: 0 in 0.761s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:40 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:40 devstack sudo[108211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33
Jul 07 23:05:40 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:41 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33" returned: 0 in 0.788s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:41 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33
Jul 07 23:05:41 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:41 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:41 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae.9f8464c4-7220-4d0e-9edd-7529114e6c33" returned: 0 in 0.660s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-9f8464c4-7220-4d0e-9edd-7529114e6c33" released by "_delete_snapshot" :: held 3.075s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:41 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-e081db4f-bf81-4afa-936b-e423a863bbae" released by "delete_snapshot" :: held 3.102s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:41 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Created reservations ['5d290001-9a3e-4382-8f7a-9198a8e70d07', 'a3cf1a7c-b953-47c5-a3ea-96c9ea0911e5', 'f92f73ae-9e1a-4757-8aad-6e62d26e6651', '156f0d9c-758c-471e-b0c0-cbe0a08660ab'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:05:42 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Delete snapshot completed successfully.
Jul 07 23:05:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-49d4b094-1653-4dbd-8d5c-79c7bf30f070 tempest-ProjectReaderTests-207751941 None] Lock "cinder-9f8464c4-7220-4d0e-9edd-7529114e6c33-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-e081db4f-bf81-4afa-936b-e423a863bbae-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:42 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Lock "cinder-e081db4f-bf81-4afa-936b-e423a863bbae-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-e081db4f-bf81-4afa-936b-e423a863bbae" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-e081db4f-bf81-4afa-936b-e423a863bbae" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccd4e3c-829d-4617-a07c-4771b19eff85]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:43 devstack sudo[108220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae
Jul 07 23:05:43 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:43 devstack sudo[108222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:05:43 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:43 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae" returned: 0 in 0.807s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:43 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:43 devstack sudo[108227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae
Jul 07 23:05:43 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:44 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.688s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG oslo_service.periodic_task [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] Running periodic task VolumeManager._thread_info {{(pid=88077) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread count: 29 {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-acad6550-b9f2-461b-bcdf-fb570c96144c None None] thread info: [<_MainThread(MainThread, started 140383052898432)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140382950455360)>, <Thread(Thread-3 (stat_writer), started daemon 140382940025600)>, <Thread(Rabbit-heartbeat, started daemon 140382940795840)>, <Thread(Thread-5 (_runner), started daemon 140382940913088)>, <Thread(Thread-7 (_runner), started daemon 140382940979840)>, <Thread(fd_logger, started daemon 140382939062720)>, <Thread(privsep_reader, started daemon 140382936840640)>, <Thread(tpool_thread_0, started daemon 140382928410304)>, <Thread(tpool_thread_1, started daemon 140382920017600)>, <Thread(tpool_thread_2, started daemon 140382911624896)>, <Thread(tpool_thread_3, started daemon 140382903232192)>, <Thread(tpool_thread_4, started daemon 140382894839488)>, <Thread(tpool_thread_5, started daemon 140382886446784)>, <Thread(tpool_thread_6, started daemon 140382878054080)>, <Thread(tpool_thread_7, started daemon 140382869661376)>, <Thread(tpool_thread_8, started daemon 140382861268672)>, <Thread(tpool_thread_9, started daemon 140382852875968)>, <Thread(tpool_thread_10, started daemon 140382844483264)>, <Thread(tpool_thread_11, started daemon 140382836090560)>, <Thread(tpool_thread_12, started daemon 140382827697856)>, <Thread(tpool_thread_13, started daemon 140382819305152)>, <Thread(tpool_thread_14, started daemon 140382810896064)>, <Thread(tpool_thread_15, started daemon 140382802486976)>, <Thread(tpool_thread_16, started daemon 140382794077888)>, <Thread(tpool_thread_17, started daemon 140382785668800)>, <Thread(tpool_thread_18, started daemon 140382777259712)>, <Thread(tpool_thread_19, started daemon 140382768850624)>, <Thread(Rabbit-heartbeat, started daemon 140382928976512)>] {{(pid=88077) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:05:44 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-e081db4f-bf81-4afa-936b-e423a863bbae" returned: 0 in 0.706s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-e081db4f-bf81-4afa-936b-e423a863bbae" released by "delete_volume" :: held 1.571s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Created reservations ['4e9cbbc2-69ce-48fe-ab6b-deb83e11cdeb', 'de71f365-cc5c-4960-a0e1-c05866d9acbe', 'c941b2ac-4f50-4574-9c18-1e9c1df8a20d', '75048030-102b-4d2a-88f4-ff0dc5a8c84f'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:44 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:44 devstack sudo[108231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:05:44 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:45 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.689s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:05:45 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Deleted volume successfully.
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-25a7169a-598e-4285-8dd1-4a18c41431cb tempest-ProjectReaderTests-207751941 None] Lock "cinder-e081db4f-bf81-4afa-936b-e423a863bbae-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Flow 'volume_create_manager' (ccdd827d-3880-4f66-be82-d322b552d102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d99dc5-2294-41e5-a041-340ebb1cd1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d99dc5-2294-41e5-a041-340ebb1cd1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465150584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfdfa47-d28b-4ccf-8851-69472c36aa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19186598f11a4905b8dab9c2ff3b70ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:46Z,use_quota=True,user_id='2b6e8b9d6f2145bdb994498d24e1b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad77967-7e0c-4988-b0ef-164711ad9c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad77967-7e0c-4988-b0ef-164711ad9c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee92bdce-9456-4da7-b651-76e4cec2a6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee92bdce-9456-4da7-b651-76e4cec2a6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdfdfa47-d28b-4ccf-8851-69472c36aa10', 'volume_name': 'volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9909f61-4174-439c-93b3-57e33096b17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9909f61-4174-439c-93b3-57e33096b17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3244a2-318b-456b-8d03-531a16fb556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:45 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Volume fdfdfa47-d28b-4ccf-8851-69472c36aa10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10', 'volume_size': 1}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1465150584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfdfa47-d28b-4ccf-8851-69472c36aa10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19186598f11a4905b8dab9c2ff3b70ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:46Z,use_quota=True,user_id='2b6e8b9d6f2145bdb994498d24e1b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Creating volume fdfdfa47-d28b-4ccf-8851-69472c36aa10 {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:05:45 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:05:45 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:45 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 1073741824
Jul 07 23:05:45 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:46 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 1073741824" returned: 0 in 0.853s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:46 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:46 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10
Jul 07 23:05:46 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:47 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10" returned: 0 in 0.672s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3244a2-318b-456b-8d03-531a16fb556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4add55-9bcf-4681-9ee2-30b436f86ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:47 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Volume volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 (fdfdfa47-d28b-4ccf-8851-69472c36aa10): created successfully
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b4add55-9bcf-4681-9ee2-30b436f86ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Flow 'volume_create_manager' (ccdd827d-3880-4f66-be82-d322b552d102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:47 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-ea4ebfeb-8361-4055-94bc-986532e784a0 tempest-ProjectReaderTests-207751941 None] Created volume successfully.
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Creating offline snapshot ed509681-9b46-4cb3-8ec2-8864913b634d of volume fdfdfa47-d28b-4ccf-8851-69472c36aa10 {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2f47a7-cd44-4c08-8449-c48bb186b875]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:47 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:48 devstack sudo[108249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10
Jul 07 23:05:48 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:48 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10" returned: 0 in 0.746s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:48 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:48 devstack sudo[108254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d 1G
Jul 07 23:05:48 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:49 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d 1G" returned: 0 in 0.805s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:49 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:49 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d
Jul 07 23:05:49 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:50 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d" returned: 0 in 0.747s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:50 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d is being set with open permissions: ugo+rw
Jul 07 23:05:50 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:50 devstack sudo[108264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d
Jul 07 23:05:50 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:51 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d" returned: 0 in 0.724s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:51 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=55,cinder:UPDATE=76,cinder:DELETE=10,cinder:INSERT=17 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:05:51 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=58,cinder:INSERT=23,cinder:UPDATE=69,cinder:DELETE=2 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:05:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:51 devstack sudo[108267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.info
Jul 07 23:05:51 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:51 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.info" returned: 0 in 0.723s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:51 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.info is being set with open permissions: ugo+rw
Jul 07 23:05:51 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:51 devstack sudo[108271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.info
Jul 07 23:05:51 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:52 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.info" returned: 0 in 0.684s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:52 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.530s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:52 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-21875f4a-53c2-4e3f-b4f2-976ee7fe4d25 tempest-ProjectReaderTests-207751941 None] Create snapshot completed successfully
Jul 07 23:05:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-ed509681-9b46-4cb3-8ec2-8864913b634d-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-ed509681-9b46-4cb3-8ec2-8864913b634d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-fdfdfa47-d28b-4ccf-8851-69472c36aa10" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-fdfdfa47-d28b-4ccf-8851-69472c36aa10" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-ed509681-9b46-4cb3-8ec2-8864913b634d" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:53 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-ed509681-9b46-4cb3-8ec2-8864913b634d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Deleting offline snapshot ed509681-9b46-4cb3-8ec2-8864913b634d of volume fdfdfa47-d28b-4ccf-8851-69472c36aa10 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:05:53 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] snapshot_file for this snap is: volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:05:53 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9c84ae-fe8a-4568-bc6d-92f34bcf6653]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:53 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:53 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d
Jul 07 23:05:53 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:54 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d" returned: 0 in 0.825s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:54 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:05:54 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1910bd-4df4-46fd-a6aa-9c8ba7815791]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:54 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:54 devstack sudo[108279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10
Jul 07 23:05:54 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:55 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10" returned: 0 in 0.844s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:55 devstack sudo[108284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d
Jul 07 23:05:55 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:55 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d" returned: 0 in 0.769s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:55 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:55 devstack sudo[108289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d
Jul 07 23:05:55 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:56 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:56 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10.ed509681-9b46-4cb3-8ec2-8864913b634d" returned: 0 in 0.712s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-ed509681-9b46-4cb3-8ec2-8864913b634d" released by "_delete_snapshot" :: held 3.252s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-fdfdfa47-d28b-4ccf-8851-69472c36aa10" released by "delete_snapshot" :: held 3.279s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:56 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Created reservations ['f0f5580e-e381-4eef-a4a4-f14b88a66eca', '017775dc-7c65-429d-b000-4efc20b1c277', '278aea29-91d4-45a9-b14d-50c82912b7ae', '6f838abd-9e31-4d0d-a821-d916834294be'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:05:56 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Delete snapshot completed successfully.
Jul 07 23:05:56 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-4aacc1a5-7db1-49fa-b3fd-63381b442bb7 tempest-ProjectReaderTests-207751941 None] Lock "cinder-ed509681-9b46-4cb3-8ec2-8864913b634d-delete_snapshot" released by "delete_snapshot" :: held 3.455s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-fdfdfa47-d28b-4ccf-8851-69472c36aa10-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Lock "cinder-fdfdfa47-d28b-4ccf-8851-69472c36aa10-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-fdfdfa47-d28b-4ccf-8851-69472c36aa10" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:57 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-fdfdfa47-d28b-4ccf-8851-69472c36aa10" acquired by "delete_volume" :: waited 0.019s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:57 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[59caf669-80ca-4bcb-9ae3-212a3dc44121]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:57 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:57 devstack sudo[108292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10
Jul 07 23:05:57 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:58 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10" returned: 0 in 0.800s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:58 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:58 devstack sudo[108297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10
Jul 07 23:05:58 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:59 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-fdfdfa47-d28b-4ccf-8851-69472c36aa10" returned: 0 in 0.687s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-fdfdfa47-d28b-4ccf-8851-69472c36aa10" released by "delete_volume" :: held 1.545s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Created reservations ['88096126-0e40-4493-a311-70c0f7b66603', 'c71aeae3-9230-4dea-ba80-29fe2f4926dc', '5dce3db8-06bd-4ba6-8a8d-d7baae32da4b', '965494e2-325d-4167-9759-6866b0548928'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:59 devstack sudo[108300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:05:59 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:59 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.741s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:59 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:06:00 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Deleted volume successfully.
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-bf5e67e1-5cb5-471f-8791-6ec84323d5a1 tempest-ProjectReaderTests-207751941 None] Lock "cinder-fdfdfa47-d28b-4ccf-8851-69472c36aa10-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.flows.manager.create_volume [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88077) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Flow 'volume_create_manager' (be9ed13a-caaf-43e7-8825-7be8590d357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb13fa1-c460-4606-a87f-47acd066d3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bb13fa1-c460-4606-a87f-47acd066d3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892320268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42f9d9f-fedf-40b8-8caf-98d9354df31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19186598f11a4905b8dab9c2ff3b70ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:06:00Z,use_quota=True,user_id='2b6e8b9d6f2145bdb994498d24e1b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3ab883-0ac0-4cfa-9fec-1c4801da21f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3ab883-0ac0-4cfa-9fec-1c4801da21f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc0534a-564a-4d84-8af0-8b62fa3d6154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc0534a-564a-4d84-8af0-8b62fa3d6154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f42f9d9f-fedf-40b8-8caf-98d9354df31c', 'volume_name': 'volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f97a53-16ca-4ceb-a81d-c2f5db1b9c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f97a53-16ca-4ceb-a81d-c2f5db1b9c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed307d9-ab79-40a8-a206-5ef7ac4bca6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:06:00 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Volume f42f9d9f-fedf-40b8-8caf-98d9354df31c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c', 'volume_size': 1}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7fad7371f470>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-892320268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f42f9d9f-fedf-40b8-8caf-98d9354df31c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19186598f11a4905b8dab9c2ff3b70ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:06:00Z,use_quota=True,user_id='2b6e8b9d6f2145bdb994498d24e1b591',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14a17955-92e0-4fb4-8a8e-97fe6f0423e7),volume_type_id=14a17955-92e0-4fb4-8a8e-97fe6f0423e7)}" {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Creating volume f42f9d9f-fedf-40b8-8caf-98d9354df31c {{(pid=88077) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Selected osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9 as target Quobyte volume. {{(pid=88077) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:06:00 devstack cinder-volume[88077]: INFO cinder.volume.drivers.remotefs [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] casted to osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9
Jul 07 23:06:00 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c 1073741824 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:00 devstack sudo[108303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c 1073741824
Jul 07 23:06:00 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:01 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c 1073741824" returned: 0 in 0.842s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:01 devstack sudo[108309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c
Jul 07 23:06:01 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:01 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c" returned: 0 in 0.665s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:01 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'} {{(pid=88077) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:06:01 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:06:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed307d9-ab79-40a8-a206-5ef7ac4bca6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c', 'volume_size': 1}' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:06:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608e786e-584b-464c-818f-f616c41aec00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:06:01 devstack cinder-volume[88077]: INFO cinder.volume.flows.manager.create_volume [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Volume volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c (f42f9d9f-fedf-40b8-8caf-98d9354df31c): created successfully
Jul 07 23:06:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608e786e-584b-464c-818f-f616c41aec00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88077) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:06:01 devstack cinder-volume[88077]: DEBUG cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Flow 'volume_create_manager' (be9ed13a-caaf-43e7-8825-7be8590d357a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88077) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:06:01 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-824548f2-d073-486f-b9ff-94fc394d5cc9 tempest-ProjectReaderTests-207751941 None] Created volume successfully.
Jul 07 23:06:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:06:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:06:02 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Creating offline snapshot eab96d6b-853b-44d2-b619-ec3e41b49db3 of volume f42f9d9f-fedf-40b8-8caf-98d9354df31c {{(pid=88077) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:06:02 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dc2efe-ee32-4295-b43f-85e86847b314]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:06:02 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:02 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c
Jul 07 23:06:02 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:03 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c" returned: 0 in 0.764s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:03 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3 1G {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:03 devstack sudo[108317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3 1G
Jul 07 23:06:03 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:04 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3 1G" returned: 0 in 0.790s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:04 devstack sudo[108322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3
Jul 07 23:06:04 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:04 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c -F qcow2 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3" returned: 0 in 0.685s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:04 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3 is being set with open permissions: ugo+rw
Jul 07 23:06:04 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:04 devstack sudo[108327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3
Jul 07 23:06:04 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:05 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3" returned: 0 in 0.638s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:05 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:05 devstack sudo[108330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.info
Jul 07 23:06:05 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:06 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.info" returned: 0 in 0.650s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:06 devstack cinder-volume[88077]: WARNING cinder.volume.drivers.remotefs [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.info is being set with open permissions: ugo+rw
Jul 07 23:06:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.info {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:06 devstack sudo[108333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.info
Jul 07 23:06:06 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:06 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.info" returned: 0 in 0.646s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:06 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.259s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:06:06 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-c30f614b-c5cf-42cc-ac7c-cad6956143ee tempest-ProjectReaderTests-207751941 None] Create snapshot completed successfully
Jul 07 23:06:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-eab96d6b-853b-44d2-b619-ec3e41b49db3-delete_snapshot" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:06:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Lock "cinder-eab96d6b-853b-44d2-b619-ec3e41b49db3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:06:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-f42f9d9f-fedf-40b8-8caf-98d9354df31c" by "delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:06:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-f42f9d9f-fedf-40b8-8caf-98d9354df31c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:06:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-eab96d6b-853b-44d2-b619-ec3e41b49db3" by "_delete_snapshot" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:06:07 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-eab96d6b-853b-44d2-b619-ec3e41b49db3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:06:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Deleting offline snapshot eab96d6b-853b-44d2-b619-ec3e41b49db3 of volume f42f9d9f-fedf-40b8-8caf-98d9354df31c {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:06:07 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] snapshot_file for this snap is: volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3 {{(pid=88077) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:06:07 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c29286f-83b5-43ba-92cb-1a0fd4aed1d7]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:06:07 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:07 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3
Jul 07 23:06:07 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:08 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3" returned: 0 in 0.751s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:08 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.remotefs [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88077) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:06:08 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac78eeee-04f8-430f-9fcf-e594eeb0e95d]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:06:08 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:08 devstack sudo[108342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c
Jul 07 23:06:08 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:09 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c" returned: 0 in 0.816s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:09 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:09 devstack sudo[108347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3
Jul 07 23:06:09 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:10 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3" returned: 0 in 0.791s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3 {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:10 devstack sudo[108352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3
Jul 07 23:06:10 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:10 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:10 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c.eab96d6b-853b-44d2-b619-ec3e41b49db3" returned: 0 in 0.633s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-eab96d6b-853b-44d2-b619-ec3e41b49db3" released by "_delete_snapshot" :: held 3.086s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:10 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-f42f9d9f-fedf-40b8-8caf-98d9354df31c" released by "delete_snapshot" :: held 3.109s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:10 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Created reservations ['3ad14be4-01a5-4182-a55c-0fc50c786e5e', '6611cb90-6c11-4af0-818f-e4cd57fcfd31', 'e93830c3-806d-4581-a1d8-2d92f4eb49da', '6468e913-d5fa-431f-afd3-35fa2750a9d6'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:06:11 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Delete snapshot completed successfully.
Jul 07 23:06:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-1b2c4d90-e991-453e-bce9-0e8e4ac67649 tempest-ProjectReaderTests-207751941 None] Lock "cinder-eab96d6b-853b-44d2-b619-ec3e41b49db3-delete_snapshot" released by "delete_snapshot" :: held 3.245s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-f42f9d9f-fedf-40b8-8caf-98d9354df31c-delete_volume" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:06:11 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Lock "cinder-f42f9d9f-fedf-40b8-8caf-98d9354df31c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:06:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Acquiring lock "cinder-quobyte-f42f9d9f-fedf-40b8-8caf-98d9354df31c" by "delete_volume" {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:06:12 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-f42f9d9f-fedf-40b8-8caf-98d9354df31c" acquired by "delete_volume" :: waited 0.020s {{(pid=88077) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:06:12 devstack cinder-volume[88077]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c214c7-c298-40c5-9040-b6a2ad1bb048]: (4, 'qcow2') {{(pid=89051) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:06:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:12 devstack sudo[108356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c
Jul 07 23:06:12 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:12 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c" returned: 0 in 0.754s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:12 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:12 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c
Jul 07 23:06:12 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:13 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f/volume-f42f9d9f-fedf-40b8-8caf-98d9354df31c" returned: 0 in 0.661s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:13 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Lock "cinder-quobyte-f42f9d9f-fedf-40b8-8caf-98d9354df31c" released by "delete_volume" :: held 1.477s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:13 devstack cinder-volume[88077]: DEBUG cinder.quota [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Created reservations ['cc9be101-d687-4865-98f8-0e6372119afb', 'e86259fb-fd16-44e1-9de5-9c00d38a5a19', '9ab43991-f09e-4869-8b64-60b5d238024d', 'f72d9235-66ae-4df6-84b3-d4947920b146'] {{(pid=88077) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:06:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:06:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:06:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9': None} {{(pid=88077) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:06:13 devstack cinder-volume[88077]: DEBUG cinder.volume.drivers.quobyte [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ab0e48f2-4581-4e07-a937-6b16bce639c9'] {{(pid=88077) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:06:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.lockutils [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88077) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:06:13 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:13 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f
Jul 07 23:06:13 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:14 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:14 devstack cinder-volume[88077]: DEBUG oslo_concurrency.processutils [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4e0ef606415a4629441ed93beaba80f" returned: 0 in 0.667s {{(pid=88077) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:14 devstack cinder-volume[88077]: DEBUG cinder.manager [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Notifying Schedulers of capabilities ... {{(pid=88077) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:06:14 devstack cinder-volume[88077]: INFO cinder.volume.manager [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Deleted volume successfully.
Jul 07 23:06:14 devstack cinder-volume[88077]: DEBUG cinder.coordination [None req-96041198-5186-43a5-b1fc-3e5b401f48dd tempest-ProjectReaderTests-207751941 None] Lock "cinder-f42f9d9f-fedf-40b8-8caf-98d9354df31c-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=88077) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:23 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=23,cinder:INSERT=8,cinder:UPDATE=34 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:06:24 devstack cinder-volume[88077]: DEBUG dbcounter [-] [88077] Writing DB stats cinder:SELECT=26,cinder:INSERT=11,cinder:UPDATE=30,cinder:DELETE=5 {{(pid=88077) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}